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Commissioner's Statement 



This report describes the relationship between vocational course taking and academic 
achievement as measured by the 1990 National Assessment of Educational Progress (NAEP). 
The report is being produced pursuant to a mandate in Section 421(h) of the Carl D. Perkins 
Vocational and Applied Technology Education Act of 1990, which requires that NAEP collect 
and report data on the educational achievement of students participating in vocational education. 

The purpose of this report is to provide baseline data on the relationship between 
vocational course taking and NAEP test scores. While the NAEP data can be used to describe 
these relationships, cross-sectional data such as the NAEP (which represent only a single point 
in time) cannot by themselves be used to explain why these relationships exist. For example, 
students who earned a large number of credits in vocational education tended to have lower 
scores on the NAEP achievement tests than did students who earned relatively few credits in 
vocational education. The inverse relationship between vocational course taking and NAEP 
scores could reflect a variety of factors, such as: 

• students who tend to have lower scores on tests such as NAEP may be more likely than 
students with higher scores to participate in vocational education; 

• students who participate extensively in vocational education and those who attain 
relatively low NAEP scores may share some other characteristic, such as being from 
a disadvantaged group; or 

• students who participate heavily in vocational education may take fever academic 
courses, which in turn may be related to their NAEP performance. 

Since the reasons for the relationships between vocational course taking and academic 
achievement cannot be determined with NAEP data, I caution against drawing conclusions about 
causation based on the NAEP data presented in this report. 



Emerson J. Elliott 

Commissioner of Education Statistics 
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Introduction 



This report describes the relationship between vocational course taking among 1^90 public 
high school graduates and their academic achievement on the 1990 National Assessment of 
Educational Progress (NAEP). It draws upon two data sets: the 1990 NAEP grade 12 
assessments, and the 1990 High School Transcript Study (HSTS), which contains transcript data 
for a nationally representative sample of 1990 graduates of high schools that were also sampled 
for thi 1990 NAEP. 1 The report focuses primarily on relationships between vocational course 
taking and performance on the NAEP math assessment, but these relationships generally hold 
for the reading and science assessments as well. Relationships between course taking and NAEP 
scores are also very briefly examined by selected student background characteristics (parents' 
educational attainment and race-ethnicity) to illustrate some unique features of the relationship 
between course taking and achievement and to aid in the interpretation of these data. Interested 
readers can explore the relationships described in this report in greater detail by referring to the 
tables in appendix A. 

The Carl D. Perkins Vocational and Applied Technology Education Act of 1990 (hereafter 
referred to as the 1990 Perkins Act) calls upon schools receiving federal vocational education 
funds to use these funds in programs that integrate academic and vocational education. This 
provision reflected recommendations made by the 1989 National Assessment of Vocational 
Education (NAVE), which found that fewer than one-half of all students who both participated 
in secondary vocational education and received no postsecondary education used their 
occupationally specific training in their jobs (Boesel et al. 1994). Because occupationally-specific 
training is of little benefit to students when they do not find related employment, the 1989 
NAVE advocated the integration of academic and vocational education so that students would 
develop broadly applicable academic skills while they were developing their more 
occupationally-specific skills. 

The effective date of the 1990 Perkins Act was July 1, 1991. Data from the 1990 NAEP 
cannot be used to evaluate the results of this legislation since the assessment preceded the date 
the legislation went into effect. The NAEP data can, however, provide a useful baseline of the 
academic achievement of students participating in vocational education before the implementation 
of the legislation. In fact, because Congress was interested in the academic skills of students 
participating in vocational education, Section 421(h) of the 1990 Perkins Act mandates that data 
from NAEP be reported on students participating in vocational education. 

While the relationship between vocational education and academic achievement is 
important, there are other outcomes related to vocational education, such as improved labor 
market outcomes and persistence in school. Vocational education has been shown to be positively 
associated with higher wages when students concentrate their course taking in a vocational field 
and work in their field of concentration (Boesel et al. 1994). Other analyses have indicated that 



'Roughly three-quarters of students in the HSTS sample have matching NAEP assessment records. See appendi 
A for a detailed description of the study sample. 
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greater vocational course taking is associated with lower dropout rates (Rasinski 1994). This 
report generally documents a negative association between course taking and NAEP 
achievement, but since the development of academic skills has not traditionally been the goal of 
vocational education, it would be wrong to draw conclusions about the overall effectiveness of 
vocational education based on the NAEP data alone. 

Since NAEP is a cross-sectional study, causal inferences about the effects of vocational 
education on academic achievement cannot be drawn. The effects of course taking cannot be 
disentangled from those of prior achievement or ability, because NAEP only records 
achievement at a single point in time. Indeed, evidence indicates that vocational course taking 
in high school is strongly associated with prior academic achievement. In a study of curriculum 
assignments in three urban comprehensive high schools, researchers found that many vocational 
education courses were viewed as a "dumping ground" for low ability students and students with 
behavioral problems (Selvin et al. 1990; Oakes et al. 1992). 2 Detailed analyses of transcript 
information from these schools revealed a negative association between prior achievement and 
concentrated vocational course taking. The authors concluded that: 

. . . concentrated vocational education coursetaking was largely, but not entirely, 
reserved for the least academically able students in the school, as measured by their 
scores on standardized achievement tests. On average, as achievement scores 
decreased, the likelihood of taking a concentration of vocational courses increased 
(Oakes et al. 1992, 60). 

The pattern of vocational concentration was also related to characteristics other than prior 
achievemt it. The study found that within schools, students of different socioeconomic and 
racial-ethnic backgrounds but comparable achievement levels varied in the extent to which they 
concentrated in vocational education, with white students being the most likely to concentrate 
in vocational education, followed by Hispanic then black students, and Asian students being the 
least likely to do so. Furthermore, the proportion of relatively high achieving students 
participating in vocational education decreased during the 1980s (Boesel et al. 1994), so the 
relationship between vocational education and academic achievement on assessments such as 
NAEP might be considerably different compared to what it was a decade ago. 

In order to draw conclusions about the nature of the relationship between course taking and 
achievement, researchers and policymakers must use longitudinal data to examine achievement 
gains, with careful controls for other explanatory factors including the availability of diiferent 
types of courses. 3 Longitudinal data allow researchers to observe the level of student 
achievement prior to taking particular courses; to measure achievement again after completing 
the courses; and then to examine how the change in achievement is related to differences in 
course taking. Recent analyses of data from the National Education Longitudinal Study of 1988 
(NELS) show that certain academic courses contribute to achievement gains, while vocational 
courses neither add to nor detract from achievement gains (Rasinski 1994). Rasinski found gains 



'This was found to be especially true for the trade-oriented vocational courses, but not for business courses (Oakes 
et ai. 1992, 60). 

For examples of such analyses, see Meyer's work with data from High School and Beyond and Rasinski's current 
work with data from the National Education Longitudinal Study of 1988 (Meyer 1992; Rasinski 1994). 



in mathematics achievement a«°cciated with taking algebra I and II, geometry, precalculus, 
calculus, and physics courses. After controlling for academic course taking, he found no 
significant relationship between vocational course taking and mathematics achievement gains in 
the model for all students, but he did find scattered positive and negative relationships for certain 
typp." of vocational courses among certain groups of students. Likewise, Meyer found in his 
analysis of the High School and Beyond sophomore cohort that vocational courses with enriched 
math content were associated with gains in mathematics achievement, although not as much as 
mathematics courses that covered the same material (Meyer 1992). These studies document the 
same patterns between vocational course taking and academic performance that are reported 
here, but their longitudinal format enabled the researchers to examine the relationship between 
vocational course taking and achievement gain after isolating other factors related to those gains. 
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Vocational Course Taking and NAEP Assessment Scores 4 



The tables in this report describe the relationship between vocational course taking and 
NAEP test scores both b> presenting the number of vocational credits earned by students in the 
different NAEP assessment score quartiles (table A), and by examining the average NAEP 
scores of students who completed varying numbers of credits in vocational education (tables B 
and C). 5 Both approaches reveal an inverse relationship between the number of credits 
accumulated in vocational education and NAEP scores. While this report concentrates on the 
analysis of average NAEP scores at different levels of vocational course taking, appendix A 
includes detailed tables that allow the interested reader to undertake an examination of credit 
accumulation by NAEP assessment score quartile. 6 

The Relationship between Measures of Curricular Participation and NAEP Test Scores 

Table A displays the average number of vocational, academic, and personal use credits 
accumulated by students in each quartile of the NAEP mathematics assessment. The data in this 
table show that students in successively higher score quartiles on the mathematics assessment 
earned more academic and fewer vocational credits than did students in the lower quartiles. 
Similar patterns were evident with respect to achievement on the NAEP science and reading 
assessments. 

Table B displays average NAEP mathematics scores for all students by the number of 
credits completed in vocational education and by other characteristics of their high school 
curriculum. For all students, mathematics achievement was inversely related to vocational 
credits, a pattern that was consistent even when other characteristics of their high school 
programs were similar. In addition, students who earned more academic credits had 
systematically higher scores on the NAEP mathematics assessment than did students who earned 
fewer academic credits. 

The apparent negative relationship between vocational course taking and NAEP assessment 
scores could reflect the positive relationship between academic course taking and test scores 
combined with less academic course taking among students with more vocational credits. There 
is a practical limit to the total number of courses a student can take while in high school, and 
while there does not appear to be a one-to-one tradeoff between academic and vocational course 
taking, analyses of high school course taking have shown that students must choose between the 
academic and vocational curriculum on the margin (Tuma et al. forthcoming). Thus, because 
NAEP tests assess skills that are typically developed in academic courses, a plausible explanation 



Courses were organized for this analysis within the Secondary School Taxonomy (Gifford et al. 1989). Appendix 
A includes a figure that shows how courses were classified as academic, vocational, or personal use. 

Lettered tables are embedded in the text of the report. Because of their size and complexity, the numbered tables 
referred to in the text appear in appendix B. 

6 The term credit in this publication refers to the equivalent of a 1-year course, or a Carnegie unit. 
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Table A— Average number of credits earned by public high school graduates in vocational, academic, and 
personal use courses by NAEP assessment score quartiles: 1990 



NAEP assessment 
and type of credits 




NAEP assessment score quartile 




Bottom 25 % 


2nd 25% 


3rd 25% 


Top 25% 


Mathematics assessment 










Total credits 


23.3 


23.4 


23.9 


24.4 


Vocational credits 


5.7 


4 fi 


3.2 


2.3 


Academic credits 


1/1 7 


1D.U 


1 R 1 
10.1 


1Q 5 


Personal use credits 


z.y 


0 ft 




L .o 


Science assessment 










Total credits 


23.3 


23.4 


23.6 


24.3 


Vocational credits 


5.5 


4.6 


3.4 


2.2 


Academic credits 


15.0 


16.0 


17.4 


19.5 


Personal use credits 


2.9 


2.8 


2.7 


2.6 


Reading assessment 3 










Total credits 


23.3 


23.5 


23.7 


24.2 


Vocational credits 


5.1 


4.4 


3.5 


2.3 


Academic credits 


15.2 


16.3 


17.5 


19.3 


Personal use credits 


3.0 


2.8 


2.6 


2.5 



Quartile assessment score ranges are as follows: below 272, 272-296, 297-319, and 320 or higher. 
Quartile assessment score ranges are as follows: below 268, 268-293, 294-322, and 323 or higher. 
'Quartile assessment score ranges are as follows: below 268, 268-291, 292-312, and 313 or higher. 



NOTES: Details may not sum to totals due to rounding. For standard errors and unweighted Ns, refer to appendix A, table 19. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 

for lower scores among students with high levels of vocational course taking is that they spend 
less time in the academic courses that develop the skills assessed on NAEP. Another possible 
explanation for the differences in achievement is that students who perform poorly in junior high 
school may earn more vocational credits and fewer academic credits in high school than other 
students. 7 

Table B also includes other aspects of students' high school records that are likely to be 
related to mathematics achievement, such as overall curricular rigor and the amount and level 
of mathematics course taking, so it is possible to examine the relationship between vocational 
course taking and achievement after taking these characteristics into account. There are 
limitations to this approach. There may be further variation within the categories defined for 
each measure; these measures do not account for other important aspects of course taking, such 
as specific content, quality of instruction, or students' mastery of the material. In addition, this 
approach isolates only one characteristic at a time, rather than simultaneously controlling for all 
characteristics of interest. Nevertheless, it is desirable to attempt to control for other aspects of 
students' course taking, and this approach permits finer exploration of the relationship between 
vocational course taking and achievement. After taking these other characteristics of students' 



Both explanations are consistent with findings by Meyer and by Rasinski, who were able to control for prior ability 
and prior achievement in their analyses of longitudinal data. 



Table B— Average NAEP matuematics score for public high school graduates, by vocational credits and 
curriculum characteristics: 1990 



Oiirrif*iilnm 


All 




Vocational credits 




Population 


characteristics 


students 


Fewer than 4.0 4.0 to 7.9 


8.0 or more 


distribution 


Total 


29oA 


308.5 


285.4 


Z09.3 


i fin n 


Curricular specialization 1 












College preparatory 


318.5 




JUO.7 





32.8 


Vocational 


276.3 




281.0 


268.4 


22.2 


All others 


290.3 


296.7 


281.1 


268.1 


45.1 


Compliance with A Nation 












at Risk recommendations^ 












All requirements 


319.4 


323.1 


308.5 





15.7 


English, math, science, 










25.4 


and social studies 


307.8 


313.4 


293.9 


— 


English and math 3 


290.2 


296.8 


286.4 


276.0 


18.9 


English 4 


277.5 


286.7 


273.6 


267.2 


14.5 


All 

All others 


ZoO. 4 


303.7 


279.9 


ZD / .*r 




Academic credits 












0.00-11.99 


264.8 




269.1 


262.9 


5.7 


12.00-15.99 


276.9 


280.3 


277.2 


272.4 


29.2 


lo.UO-19.99 


JOi. / 


305.1 


295.8 




AO 1 


20.00 or more 


320.0 


321.5 


301.0 





22.4 


Mathematics credits 












0.00-1.99 


266.0 




264.4 


— 


3.2 


2.00-2.99 


276.2 


287.1 


274.4 


266.1 


22.6 


3.00 or more 


303.9 


312.3 


291.3 


276.6 


74.2 


Highest mathematics course 












Trigonometry or higher 5 


326.0 


329.3 


314.3 




33.2 


Algebra II 


300.1 


302.6 


296.8 


293.3 


26.0 


Geometry 


284.2 


287.7 


281.3 


"31.6 


14.7 


Algebra I 


270.0 


270.6 


269.7 


270.0 


10.9 


Less than algebra I 


256.4 


257.9 


255.5 


256.4 


15.2 



—Not enough cases for a reliable estimate. 

'Students eligible for both college preparatory and vocational specializations are included in the college preparatory group. 
2 See text for a complete description of category definitions. 

3 Studcnts in this category must also have taken at least two years of science and social studies. 

4 Studcnts in this category must also have taken at least two years of mathematics, science, and social studies. 

5 Precalculus and calculus are also included in this category. 

NOTE: For standard errors and unweighted Ns, refer to appendix A, table 1. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 



programs into account, the inverse relationship between vocational credits and achievement 
generally persists. 

Table B permits examination of achievement at different levels of exposure to the 
mathematics curriculum. After taking the number of mathematics courses completed into 
account, table B shows that mathematics achievement remains inversely related to vocational 



course taking among students with 2 or more mathematics credits. With respect to the highest 
mathematics course taken, however, some interesting differences are evident. Among students 
who completed algebra II or higher courses, those with more vocational credits tended to score 
lower on the mathematics assessment. At lower levels of attainment within the mathematics 
curriculum (geometry or lower), however, achievement and vocational course taking do not 
appear to be related. 

Table B also shows achievement at different levels of compliance with the graduation 
requirements recommended for all students in the 1983 report of the National Commission on 
Excellence in Education, A Nation at Risk. 9 Figure 1 displays the average NAEP mathematics 
scores earned by students with varying degrees of compliance with these recommendatons, by 
the number of vocational credits completed. For the two most rigorous standards, comparisons 
are limited to students with low and moderate vocational course taking due to the small number 
of students with 8.0 or more vocational credits. In each of these curriculum categories, students 
with fewer vocational courses averaged higher mathematics scores. For the remaining curriculum 
standards, the inverse relationship between vocational course taking and achievement is 
statistically significant across the three levels of vocational course taking. The inverse 
relationship between vocational course taking and achievement is evident within the curriculum 
standards categories for the science and reading assesments as well (tables 2 and 3). 

Simple counts of course credits do not capture the full range of educational and curricular 
experiences. Within categories of credit completion as measured in this report, differences in 
NAEP scores may also reflect underlying differences in other important aspects of students' 
education, such as course content, quality of instruction, performance within the courses 
completed, and student learning. 



Tlie Relationship between Demographic Characteristics and NAEP Test Scores 

This section examines the relationship between vocational course taking and achievement 
within demographic subgroups. The analysis prallels that of the previous section, taking 
students' race-ethnicity and their parents' educational attainment into account. Unfortunately, 
the sample size of each of the joint assessment-transcript files is relatively small. 10 While the 
sample is sufficiently large to examine relationships among NAEP test scores, vocational course 
taking, and one other variable such as academic course taking or parents' education, it is 
insufficient for complex combinations of factors such as both academic course taking and 
parents' education. 11 



No comparison is possible among those with fewer than 2.00 mathematics credits. 
9 The recommended curriculum call for 4 years of English, 3 years each of mathematics, science, and social studies, 
2 years of a single foreign language (recommended for college-bound students), and half a year of computer science 
(National Commission on Excellence in Education 1983). The categories in table B represent one of many possible 
ways to structure degrees of compliance with the recommended curriculum; this variable assigns the greatest weight 
to English, followed by math, and then science and social stuuies. For further information, refer to appendix A. 

Each assessment uses a different sample of students. See appendix A for further information about the joint 
assevSsment-transcript samples. 

"Although the sample size does not permit cross tabulations with complex combinations of variables, it is 
sufficiently large for regression analysis. However, the NAEP data do not include key variables such as a measure 
of socioeconomic status that one might include in a regression equation. In addition, multivariate techniques such 



Figure 1— Average NAEP mathematics assessment score for public high school graduates, by compliance with 
A Nation at Risk recommendations and number of vocational credits: 1990 



Average 
score 

330 



320 - 

310 - 

300 

290 

280 

270 



260 



22L 



All English, 
recommendations' math, science, 
social studies 



Number of 
vocational credits 



p%j Under 4.0 
□ 4.0 to 7.9 



8.0 or more 




English and 
math 



English 2 



All others 



Compliance with A Nation at Risk recommendations 



NOTE: The average score cannot be estimated for students with 8.0 or more units of vocational courses who met the top two 
curriculum standards due to the small number of such students in the sample. 

! The curriculum recommended for all students in A Nation at Risk includes 4 years of English, 3 years each of mathematics, 
science, and social studies, 2 years of a single foreign language, and one half-year of computer science. See text for a complete 
definition of the measure of compliance with these recommendations. 

2 Students in this category must also have completed at least two years of science and social studies. 

3 Students in this category must al« have completed at least two years of mathematics, science, and social studies. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 1990 High School Transcript Study and 1990 
National Assessment of Educational Progress 12th Grade Assessment File. 



When participation in vocational education and academic achievement are examined by 
race-ethnicity, the same pattern found with the curriculum measures was generally evident: on 
average, students with more vocational credits had lower mathematics, science, and reading 
NAEP scores (table C and tables 5 and 6). However, the inverse relationship between vocational 



as regression cannot correct for the inherent limitations of cross-sectional data. 
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Table C— Average NAEP mathematics score for public high school graduates, by vocational credits and 



selected background characteristics: 1990 



Student 


All 


Vocational credits 




Population 


characteristics 


students 


Fewer than 4.0 


4.0 to 7.9 


8.0 or more 


distribution 


Total 


2C6 * 


308.5 


285.4 


269.5 


100.0 


Sex 












Male 


298.5 


310.1 


289.9 


271.6 


48.1 




i7t.U 


307.? 


281.3 


266.6 


51.9 


Tl a n ft— p fli n i f* 1 1 v * 












TV JliLCy UUU AiiSlJailiV 




314.1 


291.2 


272.8 


74.4 


Black, non-Hispanic 


272.1 


281.9 


265.1 


253.0 


14.5 


Hispanic 


279.4 


288.2 


271.0 




7.4 


Asian/Pacific Islander 


316.9 


323.9 


304.0 




3.1 


Parents' educational attainment 












Less than high school graduate 


273.2 


282.6 


271.1 


264.1 


7.3 


High school graduate 


283.0 


294.9 


277.9 


268.8 


24.3 


Some postsecondary education 


297.9 


308.1 


288.4 


270.5 


27.7 


Bachelor's degree or higher 


309.1 


316.9 


295.7 


274.1 


40.7 



—Not enough cases for a reliable estimate. 

The number of American Indians in the sample is too small for reliable estimates. Population distribution does not sum to 100 
percent because American Indians are not included in this table. 



NOTE: For standard errors and unweighted Ns, refer to appendix A, table 4. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 



course taking and NAEP scores that was generally evident within racial-ethnic groups was not 
found among blacks for the reading assessment. 12 

An inverse relationship between vocational credits earned and NAEP test scores was also 
evident within levels of parents' educational attainment (table C). The same pattern exists for 
reading and science achievement, except for students whose parents did not complete high school 
(tables 5 and 6). 

Figure 2 displays the average NAEP mathematics scores by parents' highest level of 
educational attainment and by the number of vocational credits completed. As with the 
curriculum measures, certain patterns stand out in addition to the negative relationship between 
vocational course taking and test scores. First, high school graduates with more highly educated 
parents had higher NAEP scores than did those whose parents had lower levels of education, and 
this relationship was evident regardless of the number of vocational credits completed. However, 
the difference in achievement between those students whose parents did not complete high school 
and those whose parents had at least a bachelor's degree was smaller for students with 8.0 or 
more vocational credits than for those with fewer than 4.0 vocational credits. This finding calls 



12 

Among Hispanics in the math and reading assessments, comparisons are only possible between low and moderate 
levels of vocational course taking. No comparisons are possible among Asian/Pacific Islanders. 

9 
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attention to the possibility of other differences that may exist within these groups— such as 
differences in the amount or nature of academic course taking— that are not evident when 
examining parents' education and vocational course taking in isolation. 



Figure 2— Average NAEP mathematics assessment score for public high school graduates, by number of 
vocational credits and parents' highest level of education: 1990 




SOURCE: U.S. Department of Education, National Center for Education Statistics, 1990 High School Transcript Study and 1990 
National Assessment of Educational Progress 12th Grade Assessment File. 
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Summary of Findings 



This Congressionally-mandated publication provides a baseline for the academic 
achievement of students talcing vocational coursework in 1990, one year prior to the effective 
date of the 1990 Perkins Act. The report describes associations between variables in the NAEP 
transcript data. These data do not permit researchers to make causal inferences about how course 
taking might influence academic achievement, since the NAEP does not measure changes in 
academic achievement. 

Nonetheless, this analysis documents an inverse association between vocational course 
taking and NAEP assessment scores. The relationship holds for mathematics, science, and 
reading achievement. The association between vocational course taking and achievement 
generally persists after attempts are made to take other curriculum characteristics and 
background characteristics into account, although it attenuates among students whose parents did 
not complete high school. With respect to mathematics achievement, the inverse relationship 
between vocational course taking and achievement on the NAEP is evident among students who 
completed high-level mathematics courses, but is not evident among those who did not complete 
algebra II or higher level courses. 

Despite the consistent finding that vocational course taking is inversely related to 
achievement on the NAEP tests, this should not be taken as evidence that increased vocational 
course taking depresses achievement for two reasons. First, this study examines achievement at 
a single point in time, and does not control for the likelihood that students who initially differ 
in ability or achievement may also differ in their propensity to enroll in vocational courses. 
Second, these patterns could reflect what Rasinski found from longitudinal analyses of the NELS 
data set: certain academic courses contribute to gains in academic test scores, and vocational 
courses neither enhance nor undermine such growth. Since there is a practical limit on the total 
number of courses a student can take, the fact that students who take more vocational courses 
have lower test scores may reflect the reduction in academic courses rather than the addition of 
vocational courses. In addition, students who earn a large number of vocational credits are less 
likely to earn credits in advanced academic courses, such as advanced English and calculus 
(Hoachlander et al. 1990), that are correlated with higher scores. 
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Table 1— Average NAEP mathematics score for public high school graduates, by vocational credits and 
curriculum characteristics: 1990 



Curriculum All Vocational credits Population 

characteristics students Fewer than 4.0 4.0 to 7.9 8.0 or more distribution 



Total 296.4 

(s.e.) (1.29) 

unweighted Ns 3,061 

Curricular specialization 1 

College preparatory 318.5 

(s.e.) (1.21) 

unweighted Ns 1,076 

Vocational 276.3 

(s.e.) (1.43) 

unweighted Ns 656 

All others 290.3 

(s.e.) (2.12) 

unweighted Ns 1,329 

Compliance with A Nation 
at Risk recommendations 2 

All requirements 319.4 

(s.e.) (1.98) 

unweighted Ns 483 

English, math, science, 

and social studies 307.8 

(s.e.) (2.35) 

unweighted Ns 870 

English and math 3 290.2 

(s.e.) (1.87) 

unweighted Ns 603 

English 4 277.5 

(s.e.) (1.58) 

unweighted Ns 434 

All others 286.4 

(s.e.) (4.04) 

unweighted Ns 671 

Academic credits 

0.00-U.99 264.8 

(s.e.) (2.27) 

unweighted Ns 145 

12.00-15.99 276.9 

(s.e.) (1.63) 

unweighted Ns 880 

16.00-19.99 301.7 

(s.e.) (1.48) 

unweighted Ns 1,309 

20.00 or more 320.0 

(s.e.) (1.92) 

unweighted Ns 727 



308.5 


285.4 


269.5 


100.0 


(.1.43) 


1,1. zy; 




N/A 


1 718 


1,037 


306 


3,061 


320.9 


308.9 





32.8 


(1.26) 


(2.66) 


(-) 


a. 99) 


883 


178 


15 


1,076 





281.0 


268.4 


22.2 


(-) 


(1.73) 


(1.74) 


(1.45) 


16 


386 


254 


656 


296.7 


281.1 


268.1 


45.1 


(2.75) 


(1.84) 


(5.20) 


(1.80) 


819 


473 


37 


1,329 


323.1 


308.5 




15.7 


(.1.83; 




v. — ) 


CI 73^ 


370 


102 


11 


483 


jijit 






25.4 


(.l.yu) 




\ ) 








91 

Zj 


S7f) 




786 4 


276.0 


18.9 




(1 11\ 






£.13 


Ill 




603 


786 7 


11% 6 


267.2 


14.5 


(1 1SC\ 




C? 30^ 


(\ 301 


1 fit 


1 OH 


87 


434 


303.7 


279.9 


267.4 


25.5 


(6 lfi\ 


C? 64^ 


(2 23^ 


(2 481 


266 


276 


129 


671 




269.1 


262.9 


5.7 


(-) 


(5.85) 


(2.37) 


(0.87) 


4 


40 


101 


145 


280.3 


277.2 


272.4 


29.2 


(3.85) 


(1.66) 


(2.05) 


(1.39) 


182 


521 


177 


880 


305.1 


295.8 




42.7 


(1.73) 


(1.80) 


(-) 


(1.54) 


855 


431 


23 


1,309 


321.5 


301.0 




22.4 


(1.70) 


(7.18) 


(-) 


(1.62) 


677 


45 


5 


727 



14 



24 



Table 1— Average NAEP mathematics score for public high school graduates, by vocational credits and 
curriculum characteristics: 1990— Continued 



266.0 




264.4 




3.2 


(4.41) 


(-) 


(7.51) 


(-) 


(0.63) 


81 


20 


37 


24 


81 


276.2 


287.1 


274.4 


266.1 


22.6 


(1.48) 


(2.45) 


(1.87) 


(1.93) 


(1.40) 


624 


201 


264 


159 


624 


303.9 


312.3 


291.3 


276.6 


74.2 


(1.58) 


(1.50) 


(1.63) 


(3.29) 


(1.35) 


2,356 


1,497 


736 


123 


2,356 



Curriculum All Vocational credits Population 

characteristics students Fewer than 4.0 4.0 to 7.9 8.0 or more distribution 

Mathematics credits 
0.00-1.99 
(s.e.) 

unweighted Ns 
2.00-2.99 
(s.e.) 

unweighted Ns 
3.00 or «u< .'e 
(s.e.) 

unweighted Ns 

Highest mathematics course 
Trigonometry or higher 5 
(s.e.) 

unweighted Ns 
Algebra II 
(s.e.) 

unweighted Ns 
Geometry 
(s.e.) 

unweighted Ns 
Algebra I 
(s.e.) 

unweighted Ns 
Less than algebra I 
(s.e.) 

unweighted Ns 

N/A Not applicable. 
—Not enough cases for a reliable estimate. 

Students eligible for both college preparatory and vocational applications are included in the college preparatory group 
3 See text for a complete description of category definitions. 

Students in this category must also have taken at least two years of science and social studies. 

Students in this category must also have taken at least two years of mathematics, science, and social studie- 

Precalculus and calculus are also included in this category. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 



326.0 


329.3 


314.3 




33.2 


(1.49) 


(1.33) 


(3.31) 


(-) 


(1.93) 


1,067 


836 


219 


12 


1,067 


300.1 


302.6 


296.8 


293.3 


26.0 


(0.99) 


(1.30) 


(1.12) 


(3.63) 


(1.28) 


769 


467 


263 


39 


769 


284.2 


287.7 


:!81.3 


281.6 


14.7 


(1.88) 


(1.92) 


(2.57) 


(3.30) 


(1.20) 


472 


216 


206 


50 


472 


270.0 


270.6 


269.7 


270.0 


10.9 


(1.45) 


(3.09) 


(2.02) 


(2.22) 


(0.92) 


317 


90 


157 


70 


317 


256.4 


257.9 


255.5 


256.4 


15.2 


(1.32) 


(2.59) 


(2.00) 


(2.04) 


(0.90) 


436 


109 


192 


135 


436 



15 



25 
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Table 2- Average NAEP science score for public high school graduates, by vocational credits and curriculum 
characteristics: 1990 ■ 



Curriculum 
characteristics 



All 
students 



Vocational credits 



Fewer than 4.0 4.0 to 7.9 



Population 

8.0 or more distribution 



Total 
(s.e.) 

unweighted Ns 

Curricular specialization 1 
College preparatory 
(s.e.) 

unweighted Ns 
Vocational 
(s.e.) 

unweighted Ns 
All others 
(s.e.) 

unweighted Ns 

Compliance with A Nation 
at Risk recommendations 2 
All requirements 
(s.e.) * 

unweighted Ns 
English, math, science, 
and social studies 
(s.e.) 

unweighted Ns 
English and math 3 
(s.e.) 

unweighted Ns 
English 4 
(s.e.) 

unweighted Ns 
All others 
(s.e.) 

unweighted Ns 

Academic credits 
0.00-11.99 
(s.e.) 

unweighted Ns 
12.00-15.99 
(s.e.) 

unweighted Ns 
16.00-19.99 
(s.e.) 

unweighted Ns 
20.00 or more 
(s.e.) 

unweighted Ns 



295.0 
(1.56) 
3,123 

319.5 
(2.17) 
1,080 
273.6 
(2.22) 
697 
288.7 
(2.48) 
1,346 



318.6 
(3.28) 
448 

309.6 
(2.42) 

905 
285.1 
(2.37) 

660 
278.4 
(1.78) 

429 
284.8 
(4.81) 

681 



259.8 
(4.35) 

161 
275.8 
(2.10) 

946 
300.0 
(1.87) 
1,269 
321.8 
(2.89) 

747 



309.1 
(1.95) 
1,732 

323.1 
(2.01) 
884 

(-) 
17 
297.0 
(3.31) 

831 



324.3 
(2.52) 
333 

316.6 
(2.16) 

671 
291.9 
(3.00) 

321 
289.3 
(2.65) 

137 
306.5 
(7.63) 

270 



(-) 
7 

285.2 
(5.36) 

178 
303.2 
(2-14) 

857 
324.0 
(2.50) 

690 



281.2 
(1.74) 
1,069 

303.3 
(5.18) 

188 
277.9 
(2.52) 

405 
276.5 
(2.03) 

476 



301.1 
(6.19) 
111 

290.9 
(3.92) 

201 
279.7 
(3.36) 

268 
275.0 
(2.66) 

228 
275.6 
(3.04) 

261 



257.7 
(5.54) 

54 
275.6 
(2.13) 

569 
293.1 
(3.24) 

392 
293.8 
(10.35) 
54 



265.9 
(2.55) 
322 



(-) 
8 

267.4 
(2.91) 
275 
251.9 
(5.68) 
39 



(-) 
4 

270.8 
(7.45) 

33 
271.3 
(4.79) 

71 
264.3 
(4.63) 

64 
263.9 
(3.62) 
150 



260.6 
(4.94) 

100 
267.5 
(2.75) 

199 

(-) 
20 

(-) 
3 



100.0 
N/A 
3,123 

31.5 
(1.74) 
1,080 

22.8 
(1.17) 
697 

45.7 
(1.84) 

1,346 



13.2 
(1.37) 
448 

26.4 
(1.38) 
905 
20.5 
(1.21) 
660 
14.2 
(1.16) 
429 
25.8 
(2.70) 
681 



6.1 
(0.82) 

161 
31.2 
(1.56) 

946 

39.8 
(1.19) 
1,269 

22.9 
(1.51) 

747 



N/A Not applicable. 

—Not enough cases for a reliable estimate. _ 

'Students eligible for both college preparatory and vocational concentrator arc included in the college preparatory group. 
2 Sce text for a complete description of category definitions. 

'Students in this category must also have taken at least two years of science and social studies 

4 Studcnts in this category must also have taken at least two years of mathematics, science, and social studies. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 3— Average NAEP reading score for public high school graduates, by vocational credits and curriculum 
characteristics: 1990 



cnaraciensucs 


All 
All 

students 


Vocational credits 
Fewer than 4.0 4.0 to 7.9 


8.0 or more 


Population 
distribution 


1 Dial 


9QO < 
ZoV. J 


299.3 


280.0 


269.4 


100.0 


(s.e.) 


(1.43) 


(1.78) 


(1.41) 


(2.16) 


N/A 


unweighted Ns 


3,106 


1,716 


1,106 


284 


3,106 


v^uilll*uial oucdallx^lllUll 












College preparatory 


306.3 


308.4 


907 1 




32.2 


(s.e.) 


(1.94) 


CI 691 


C4 071 


C— 1 


CI 741 
(i. it) 


unweighted Ns 


1,086 


879 
o/Z 


919 
Z1Z 


2 


1,086 


Vocational 


274.6 


987 « 
ZO / .0 


97A 7 
Z/O. / 


269.9 


24.1 


(s.e.) 


(1.50) 


C7 331 


CI 711 
(I. 13) 


(2 251 


CI 401 


unweighted Ns 


715 


24 


446 


245 


715 


All others 


285.3 


900 0 


97ft 4 
Z/O.t 


265.1 


43. 7 


(s.e.) 


■ (2.14) 


(2 901 


CI CS71 


(4.40) 


(1.92) 


unweighted Ns 


1,305 


820 


448 


37 


1,305 


v^UIIipilailLc Willi /l LvCLllOn 












c4/ AiiA rccuiiuiicnu<iiions 












All requirements 


305.8 


308.6 


297.8 


— 


14.0 


{s.e.) 


(2.47) 


(2.46) 


(4.48) 


(-) 


(1.45) 


unweighted Ns 


466 


340 


124 


2 


466 


English, math, science, 












and social studies 


297.0 


301.1 


285.6 


— 


26.4 


(s.e.) 


(2.77) 


(2.93) 


(3.43) 


(-) 


(1.45) 


unweigmcu iNb 


OOyl 

004 




91 f. 
Z10 


25 


884 


English and math^ 


285.0 


901 I 


97Q S 


ZOo. J 


1 8 8 
lo.o 


(s.e.) 


(2.02) 


CI QA.\ 


C9 8 1 ^ 




n 401 


unweighted Ns 


624 


908 


970 
Z/U 


56 


624 


English'' 


277.8 


283.9 


275.3 


271.9 


15.8 


(s.e.) 


(1.59) 




ci an 


(2.531 


d 381 


unweighted Ns 


473 


167 


999 


84 


473 


All others 


293.3 


300.3 


21 A .4 


267.0 


25.0 


(s.e.) 


(3.30) 


C5 161 

(J. IV) 


C9 911 


(2.55) 


(2.91) 


unweighted Ns 


659 


268 


21 A. 


117 


659 


/\CaUCIlUC crcuiia 












0 00- 1 1 00 
u.uu ii. yy 


9A8 /I 
ZOO. 4 




9fi8 4 


266.7 


5.9 


Cs e 1 


C9 


(-) 


(4.41) 


(3.27) 
88 


(0.72) 


unweighted Ns 


146 


6 


52 


146 


12.00-15.99 


274.3 


279.6 


273.9 


270.5 


29.6 


(s.e.) 


(1.55) 


(4.18) 


(1.64) 


(2.97) 


(1.34) 


unweighted Ns 


892 


156 


561 


175 


892 


16.00-19.99 


292.0 


294.1 


288.2 




41.9 


(s.e.) 


(2.10) 


(2.56) 


(2.82) 


(-) 


(1.48) 


unweighted Ns 


1,334 


870 


449 


15 


1,334 


20.00 or more 


310.2 


311.1 


299.9 




22.6 


(s.e.) 


(1.80) 


(1.77) 


(5.46) 


(-) 


(1.47) 


unweighted Ns 


734 


684 


44 


6 


734 



N/A Not applicable. 

—Not enough cases for a reliable estimate. 

Students eligible for both college preparatory and vocational specializations are included in the college preparatory group. 
See text for a complete description of category definitions. 

^Students in this category must also have taken at least two years of science and social studies. 
Students in this category must also have taken at least two years of mathematics, science, and social studies. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 4— Average NAEP mathematics score for public high school graduates, by vocational credits and 
selected background characteristics: 1990 



Student 
characteristics 



All 

students 



Vocational credits 



Fewer than 4.0 4.0 to 7.9 8.0 or more 



Population 
distribution 



Total 
(s.e.) 

unweighted Ns 

Sex 
Male 
(s.e.) 

unweighted Ns 
Female 
(s.e.) 

unweighted Ns 

Race- ethnicity* 

White, non-Hispanic 
(s.e.) 

unweighted Ns 
Black, non-Hispanic 
(s.e.) 

unweighted Ns 
Hispanic 
(s.e.) 

unweighted Ns 
Asian/Pacific Islander 
(s.e.) 

unweighted Ns 

Parents' educational attainment 
Less than high school graduate 
(s.e.) 

unweighted Ns 
High school graduate 
(s.e.) 

unweighted Ns 
Some postsecondary education 
(s.e.) 

unweighted Ns 
Bachelor's degree or higher 
(s.e.) 

unweighted Ns 



296.4 



508.5 



285.4 



269.5 



100.0 



(1.29) 


(1.45) 


(1.29) 


(1.64) 


N/A 


3,061 


1,718 


1,037 


306 


3,061 


298.5 


310.1 


289.9 


271.6 


48.1 


(1.53) 


(1.80) 


(1.45) 


(2.00) 


(0.92) 


1,445 


793 


488 


164 


1,445 


294.6 


307.2 


281.3 


266.6 


51.9 


(1.43) 


(1.56) 


(1.79) 


(2.49) 


(0.92) 


1,616 


925 


549 


142 


1,616 



302.0 


314.1 


291.2 


272.8 


74.4 


(1.30) 


(1.51) 


(1.27) 


(1.83) 


(0.63) 


2,236 


1,286 


711 


239 


2,236 


272.1 


281.9 


265.1 


253.0 


14.5 


(2.01) 


(2.37) 


(2.78) 


(4.95) 


(0.521 


440 


216 


184 


40 


440 


279.4 


288.2 


271.0 




7.4 


(2.92) 


(3.47) 


(3.56) 


(-) 


(0.46) 


255 


133 


96 


26 


255 


316.9 


323.9 


304.0 




3.1 


(5.51) 


(4.23) 


(5.39) 


(-) 


(0.32) 


108 


74 


34 


0 


108 


273.2 


282.6 


271.1 


264.1 


7.3 


(2.42) 


(3.92) 


(2.90) 


(4.72) 


(0.76) 


244 


80 


114 


50 


244 


283.0 


294.9 


277.9 


268.8 


24.3 


(1.68) 


(2.60) 


(1.92) 


(2.14) 


(1.13) 


708 




303 


115 


708 


297.9 


308.1 


288.4 


270.5 


27.7 


(1.15) 


(1.76) 


(1.69) 


(3.13) 


(0.91) 


831 


470 


297 


64 


831 


309.1 


316.9 


295.7 


274.1 


40.7 


(1.62) 


(1.79) 


(1.99) 


(2.65) 


(1-28) 


1,210 


849 


299 


62 


1,210 



N/A Not applicable. 

—Not enough cases for a reliable estimate. 

*The number of American Indians in the sample is too smuil for reliable estimates. Population distribution does not sum to 100 
percent because American Indians are not included in this table. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 5— Average NAEP science score for public high school graduates, by vocational credits and selected 
background characteristics: 1990 



Student 
characteristics 



All 
students 



Vocational credits 



Fewer than 4.0 4.0 to 7.9 8.0 or more 



Population 
distribution 



Total 
(s.e.) 

unweighted Ns 



Sex 



Male 
(s.e.) 

unweighted Ns 
Female 
(s.e.) 

unweighted Ns 

Race-ethnicity* 

White, non-Hispanic 
(s.e.) 

unweighted Ns 
Black, non-Hispanic 
(s.e.) 

unweighted Ns 
Hispanic 
(s.e.) 

unweighted Ns 
Asian/Pacific Islander 
(s.e.) 

unweighted Ns 

Parents' educational attainment 
Less than high school graduate 
(s.e.) 

unweighted Ns 
High school graduate 
(s.e.) 

unweighted Ns 
Some postsecondary education 
(s.e.) 

unweighted Ns 
Bachelor's degree or higher 
(s.e.) 

unweighted Ns 



295.0 
(1.56) 
3,123 



309.1 
(1.95) 
1,732 



281.2 
(1.74) 
1,069 



265.9 
(2.55) 
322 



100.0 
N/A 
3,123 



300.2 


316.0 


286.1 


268.8 


46.5 


(1.80) 


(2.32) 


(2.17) 


(2.81) 


(1.11) 


1,442 


790 


488 


164 


1,442 


290.4 


303.3 


276.9 


263.0 


53.5 


(1.67) 


(2.15) 


(2.07) 


(3.70) 
158 


(1.11) 


1,681 


942 


581 


1,681 



302.7 


317.0 


238.9 


271.7 


73.2 


(1.59) 


(1.74) 


(A. 86) 


(2.95) 


(0.85) 


2,208 


1,233 


735 


240 


2,208 


262.1 


272.6 


252.9 


243.2 


14.1 


(2.42) 


(3.43) 


(3.35) 


(5.36) 


(0.66) 


409 


198 


167 


44 


409 


277.0 


290.3 


265.6 


251.9 


8.1 


(3.33) 


(4.62) 


(4.19) 


(6.31) 


(0.42) 


318 


173 


114 


31 


318 


309.4 


321.2 


285.1 




3.8 


(10.62) 


(9.16) 


(9.24) 


(-) 


(0.34) 


154 


114 


36 


4 


154 



270.7 


282.3 


270.1 


260.2 


7.6 


(3.82) 


(5.93) 


(4.50) 


(5.72) 


(0.83) 


251 


84 


106 


61 


251 


279.8 


291.4 


276.0 


266.0 


23.6 


(1.85) 


(3.16) 


(2.61) 


(3.61) 


(0.95) 


726 


271 


335 


120 


726 


296.1 


306.7 


283.2 


274.0 


28.5 


(1.79) 


(2.12) 


(2.52) 


(4.29) 


(1-10) 


846 


486 


290 


70 


846 


310.3 


318.9 


291.6 


274.6 


40.3 


(1.74) 


(2.15) 


(2.61) 


(5.19) 


(1.77) 


1,227 


863 


308 


56 


1,227 



N/A Not applicable. 

—Not enough cases for a reliable estimate. 

The number of American Indians in the sample is too small for reliable estimates. Population distribution does not ■ 
percent because American Indians are not included in this table. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 6— Average NAEP reading score for public h ! gh schooi graduates, by vocational credits and selected 
background characteristics; 1990 



Student 
characteristics 



All 
students 



Vocational credits 



Fewer than 4.0 4.0 to 7.9 8.0 or more 



Population 
distribution 



Total 
(s.e.) 

unweighted Ns 

Sex 
Male 
(s.e.) 

unweighted Ns 
Female 
(s.e.) 

unweighted Ns 

Race-ethnicity* 
White, non-Hispanic 
(s.e.) 

unweighted Ns 
Black, non-Hispanic 
(s.e.) 

unweighted Ns 
Hispanic 
(s.e.) 

unweighted Ns 
Asian/Pacific Islander 
(s.e.) 

unweighted Ns 

Parents' educational attainment 
Less than high school graduate 
(s.e.) 

unweighted Ns 
High school graduate 
(s.e.) 

unweighted Ns 
Some postsecondary education 
(s.e.) 

unweighted Ns 
Bachelor's degree or higher 
(s.e.) 

unweighted Ns 



289.5 
(1-43) 
3,106 



284.8 
(1.79) 
1,462 
293.8 
(1.39) 
1,644 



299.3 


280.0 


269.4 


100.0 


(1.78) 


(1.41) 


(2.16) 


N/A 


1,716 


1,106 


284 


3,106 


294.6 


276.5 


264.5 


48.0 


(2.35) 


(1.74) 


(3.02) 


(0.95) 


788 


529 


145 


1,462 


303.4 


283.4 


274.4 


52.0 


(1.63) 


(1.54) 


(3.08) 


(0.95) 


928 


577 


139 


1,644 



294.3 


304.9 


284.6 


270.0 


75.1 


(1.34) 


(1.55) 


(LSI) 


(2.00) 


(0.98) 


2,256 


1,249 


775 


232 


2,256 


271.1 


276.2 


265.7 


271.8 


13.9 


(2.72) 


(4.89) 


(2.76) 


(3.99) 


(0.91) 


400 


184 


182 


34 


400 


275.1 


282.9 


268.2 




7.2 


(3.56) 


(4.43) 


(4.20) 


(-) 


(0.41) 


288 


159 


112 


17 


288 


289 " 


291.7 






3.2 


(5.08) 


(5.70) 


(-) 


(-) 


(0.28) 


138 


110 


27 


1 


138 



273.0 


279.2 


270.2 


270.2 


7.4 


(2.09) 


(4.49) 


(2.60) 


(4.20) 


(0.64) 


257 


89 


119 


49 


257 


280.5 


289.6 


276.8 


269.4 


24.8 


(1.65) 


(2.85) 


(1.74) 


(3.24) 


(L10) 


737 


288 


339 


110 


737 


292.9 


301.5 


284.9 


271.7 


26.5 


(1.66) 


(L87) 


(1.87) 


(3.70) 


(1.29) 


805 


451 


299 


55 


805 


297.1 


303.9 


283.7 


271.0 


41.3 


(1.82) 


(2.14) 


(2.56) 


(4 *3) 


(L65) 


1,239 


866 


316 


57 


1,239 



N/A Not applicable. 

—Not enough cases for a reliable estimate. 

*The number of American Indians in the sample is too small for reliable estimates. Population distribution does not sum to 100 
percent because American Indians are not included in this table. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 



20 



ERIC 



8 
•a 



JB 

•*-» 

OS 

a 



8 



1 

8. 

T3 



T3 

s 

cs 

■a 

c 
© 

•■a 



x> 

2 

11 

w -5 

(A U 

js 2 
m a 

a l 

al 



1 



a 



< 

I 

r- 

3 
as 
H 



Sz 



•a t& 



I* 

S in 

o cN 
oa 

a 8 
52 1 



i2a 



T3 

CO *o 

CO ts 



"2 * 
f * 

oa 

-I 
32 1 



i2a 



£3 



•a tR 



oa 

= § 
3-3 



S t3 



vo ' — 

. O 00 
CN — r~ 

d «- 



^ 5 
• O CO 

n ~ " 



oo jr- r- 



Nog 



Cv ' [-^ 

*"' d 



H J^O 

• ov 00 

oo — ■ p». 
""' d 



o cr- 

• Ov rsl 
VO — r~- 

d 



""' d 



CO iT-OO 
• On r-^ 

ts O t~ 



f-O ^-s O 

^ 2 oo 

CO — 



vo rr-c- 
^ *r r~ 



>o r~ 
o 



Ov J^"- 1 

co — <§ 

©co" 



"8 

XI 
60 

s co a 

o w 3 



© ° p. 



;~>oo co <T-^o O jr-vq 
n« • co ov • co cn 

—iJ^CN— ' CO— 

odd. 



I .5 CM — fM CO 



CO 



Ov i^>vo ^00 CO J^-CM 
.OS . fl « • CO jsl 

odd 



w ' o ft. 2"; © in • 2; CN 

N-< vo CO © tn 



CM — ' © rs — ' vo 

d d 



CO 

o 



CN r< "- 1 ^ r-i 



Ov CO 

o 



vo 



vp U"> j 

d p. 



d d ""p. 



Ov<-i( =) CO'-'vO VO ' - 'CO 



—i ^ 0\ t— iC^o co r> vo 
© — .-•^co^ScS 

d 



CN — in vo <N 

© p. 



• vn in . vo o ; ") n 
d d d. 



ov oco cs C?<2> J?vn 
• ov vo • *" o • ^ <n 
escN^ic^cNpJco^cX 



. CN rt 



r>vo co ^r-vo 
CNr~- ^Om-^es 



CN o P» vo 

d o 



■a g% 
So « 



£2 

OS 

Cu 



"8 



z 
"8 



a, 



o _ 



Z 

00 



u > < 



4> ? 



CS ^ vN 
O 



12 >n 

CN >— 1 _ i 

d 



• ©, vo 
CO CS 



co 'T-m 

^p 



• OV 

Ov •— i _i 



. Ov vo 
00 CN 



-•00 



r~ -r-co 

• VO 00 
Ov — 



IN — CS 

o 



00 ;~-vO 
CN^2 



• ^ vo 
CO CO 



oo c*co 

^ ^ 00 

^ —l •* 



vo c? co vo r> 

.No ; CN ov 
(N — ' ?R CN CS w 



VO CT-P p ; 



CN CN S 
O 



>>n oo ; 



co fC - bo ^ ~i c- r- CM 
CN R CO -h CN — CS — ^ 



Ov Ov 'T- -<t VO ^-00 00 Ct~- 

• vnS;COfi;Ovco-*tr> 

CN— ■UiCN'-'UiCN— iU.CN — ^ 

©©S3 

COCN^CN--^;CN-^ c sCN--^tN 

dp,©©, 



CS 5-S ?| CN -h So CN vo CN — 5 CN ^ vo 

d d d d o 



O CO OO 'T- rf 

• m o ■ © av 
O — cn P» co 

d o 



'T* vo >n jr- p 
X"od?2 

^ d 



ov cn r- co tl r~ ^ vo „ 

" d. d, *" p, ' ^ e 



rf 'T-rJ- O CS 'T-OO — 

• O rt • 00 pi •Ov<r>-Ovr» 
OOCN^vOCN^in — V^TtCN^, 



t--^cOTt^Ov'<l-25->Q'- l ^ , ,r; 

^oCJ^cN^^°Sco-Sjq 
~d *"S " © " © 

• OfC .(On • Ov • CO r- 
OvCN 0 0 v OCNvo l O' _l rr T * -c,1 vo 

^ d " d ^ d — d 



CM ^ fn co cm 



°i PS 

CS CM .-J 

d 



CMCM^COCN^JcOCO 1 rrco^. 



— '--rr vo 



cn ^oo in 



VO rr\ • r»- r>. 



cocN^^t-cN^mcNiJvncNU 



.Ovki • VD P. • ON o ■ S in 

d o o o 



• 0 cm ^> co o 
grf-H^m^^ivn 
d 



P~ fC© CN 
CM 00 ^ VO 

p. ©, 



1 s 

o 0 



<0 
u 
c 

V 

a Til 



Hi* ^ 



z 



■8 



00 



J3 
.2P* 



.00 .-o .3 

oi ? « oj ? oi ? -.2 oi 
* a 'oo'g w 9 "eb « 9 "eb to 



1 = 



Ov r-^ 
CM £ 

d 



z 

op 



M 

co 



CO 



21 



d 

ERIC 



8z 



t2 v 



4) 

•E 

•a fiS 

3" 8 
8 

Oh 

3 



Its 

■§» 

CQ 

43 

g 8 



t -1 CN 



I* 
is 

OQ 

43 

52 1 



g TJ tfc 



2 



CN (s) 



I* 5 
OQ 

43 

= 5 
*1 



E to 



d 



t» O 
cn ~ 



v© cv© ° 



CN i 



CN 


r» 
cn 


.13) 
364 


cn 


^ — s 

CM 


r~ 
c- 
cn 


vo 

CN 


.11) 

637 


"1 
CN 




d 


o 




O 






o 


d 


C <N 
2 


t> 
cn 


.12) 
407 


CN 

cn 


/■ — s 

CM 


<N 
CN 
CN 


r~ 

CN 


.14) 
532 


"1 
CN 


.13) 
217 


O 




o 




O 






o 




q. 


cs oo 
1 CN 


00 

cn 


'™>00 

— ° 


in 
CN 


n? 


Ov 


3.2 
.11) 
328 


t> 

CN 


.11) 
302 


o 




o 




d 






o 




o 


,12) 
416 


q 
en 


,12) 
230 


en 
cn 




** 

en 


in 
pi 


.13) 
221 


o\ 

CN 


.14) 
382 


o 




q. 




q. 






o 




o 


O oo 
"I 00 


00 

cn 


.10) 
309 


CN 


, — V 
t— ( 


Si 
r~ 


Ov 
CN 


/-\00 

o S 


l> 
rsJ 


.10) 
037 


o 




o 




d 






O _T 




w 



oo o S M ^ ^ 



o p, 04 q 



"O\cnC< N l° 0 C> t >C< s " 

~ d - d d 



vo cc- o\ c°° <t C 00 cn c*" 



»»» * cn 



Tf jr>\© oo c^o cn «n 
-d -d -d ^cn 



o — "Z^Ooot^Ocn^. 



d 



o • 

, CO . 

d 



.00 
00 T)- 



• CN n\ • O 



oo o° CO 

• On ^ . cn oo 
oo CN ^ <n — oo 



43 

1 

o 

o 
S d 

< 



Ov 



ON 

0\ 



| . — - 4> 



(A 

£ 6 
.2? >- 

. 0} o 



Z 

Of) 



o cr- cn £>o C 
^ ^2 « i^: S3 1 

d ^ d. 



cn 't-cn cn C>h m C— ' 
OxcNvrjsOCNfsicncn 
d d d. 



00 fOOD cn j?n vo c>r— 

. VO N . f— ; . OV rt. 
t ^PjlnCN^CNCN^ 

d d ^ d. 



d " o ~ d 



00 
CN 


,11) 
364. 
1.5 


.08) 
377 




.06) 




o 


o 




O 


CN 
cn 


.15) 
407 
1.5 


.11) 

222 


o\ 


.07) 
532 




o 


q. 




o 


cn 


CO" 00 

S ° 
. cn " — 




2.2 
.06) 
328 




O 


d 




q. 


00 

cn 


.20) 
230 
4.1 


^cn 


in 

CN 


.06) 
221 




o 


^ — ' 




o 


cn 
cn 


.11) 
309 
1.6 


Cf~- 
cn (si 

. f~- 


o\ 


^ — . oo 
°. t- 






q. 




o ^-T 



, 2 ^ So Pi ^ 

oo — f^m — o Nr ln 
' - d^"d^" - d 



iT~vo 

S>2 



o , 
d 



-nSgc 
d __T 



Z 



(A 

Z 



" Ov 

n cn 



ON 
60 S 



Z 

"8 8 "3 



* 6 



CN 



Y O g « C g ncn^-^gr-: - 
vo o o 

CN (jO 
> 



op 
» ? 



J3 
00 

, ° » * 

00 



"v vo O 
,^CN-!C 



CN 


en 


'1 


vo 


VO 
CN 


2^ 


2.7 
680 


q. 










d 


q. 


^— ^ 
en 


r~ 

Ov 


'1 


m 

CN 


r- 

CN 


.15) 
200 


o\ J^N 
. oo > 
CN O g 


d 










o 


q. 




en 
r- 


oo c 

. Ov 

cn cn 


C7v 


r- 

CN 


,15) 
303 


3.1 
.13) 
424 


d 




d 






o 


q. 




8 

en 


00 

. 

CN CN 


00 


VO 
CN 


,12) 
624 


oo cvo 
cn q cn 


d. 




d 






q. 


o,cn 



1 1 1^ | 2 g 



cn CO 

. co a . oo oo 
vol- oo-ig 

d " d 



s «n m CQ o\ c^ 
^ - £ o ,a 2 ° 
It "I cn *S m 
o o 



m — kv "~ 



cn r~- 
" d 



en ^£ <*J 
o o 



. in no « r"- rsl • vO i/s 

" d " p. ^ p,^ 



cn cn q vn 



cn 


cn 


1 


^ — ^ 

x 


vO 




c?^ 
cn 


q 
m" 


.15) 
680 


d 












q. 




q. 


^— ^ 
cn 


r~ 

Ov 


1 






5.5 
.21) 
200 




00 Q 

"I >n 


d 
















q. 


, — ■. 
Ov 


cn 
r~ 


m 
vo 


m 
r~ 


Ov 


VO 


.27) 
303 


q 
in 


.21) 
424 


q. 






d 






o 




q. 


cn 


8 

en 


CN 
vo* 


cn 

VO 


oo 


VO 
in 


,18) 
624 


en 


,13) 
356 


d 






d 






o 




9- 



(J 

.38 



Z 
1 



(A 

Z 

■8 



i T « iJ . 

|8^§8 

« d CN 



J= Ov -C 

opSv .W 

S (sj .'Jo 

J 1> ? 



o 
en 



Z 

"° 3 



CO 



9 

ERIC 



22 



CO 



8 



S 

6. 



s 

3 



•a 

3 c 
5 -a 
? s 

8. 



■O V-H 



"° 1 



11 



a! 



"2* 

8 



u 



00 

t/5 



•O 6ft 
CD 

3 I 



T3 68 
^53 



3jQ 



o cs 

CO 



e c 



I 

S 
« 



S w 

'E S 

3 2 

U o 



CS — S CS -* 



*oo -sgjO-: 



■■in 



c4 s s cs s s n a 2 

odd 



CSCS^CS — cJcS--; C n|CS-; 1 _,CS--; 1 



■ ^ la : St vo ^ r-- O _c • 3 c«-> 



00 JT-00 — ^T" - 
• Ov \© • os 
Ov — ■ vo 00 c*> 

— 6 p. 



. 00 oo • VO _• O 
O\CSf4O0CSjiVC>«SS 

^ d ~" d ""' p. 



cs 

vd in 
^ d 



. O O T-CS VO ^~-CS Ct vo £>00 

^^."•^vo.^t^cn'Soo-JSin 



(^cs5t--cStSvocsSJ2 c i f * > 2 cv J Tl ' 
^ d ~* ~* d ~*d ""' o o 



cs sr-oo ov — 
csSjgcsN^ 

d. d. 



t- ^vvo CS 00 

cscs^fO'-^fncsX 
ddp. 



I cs I I 



"! o C 1 o 5} ^ ^ S-o p ~p 
^^^Trcs<Q-<tcScs , '>r v J<--' c * 1t '! 
o o d o o 



d d d. d. P' 



n q s " £ * ~ 5 * S s * 3 5 



z 



§•3 U 
OO-* 5 v> 
C ' 
H 



•8 



00 ~* 

■s fi 



•8 "8 



00 00 

» s a 6 



3 2 

oo g 

J' 



•8 

00 



g|t^§ S 

§H ° 5 O ^ J 



s 

as 
o 



u 
so 
u 

o 



"8 



» "2 
u c 



•o 

3 



0) 

'8. 



S S 

o o 



7 « y r 

.2 c ^ £ 

w o *^ 



v . OT 

s s 

_. o — — 
°* ^ e c 

■a E ?{ o o 
= S " > ?: 
•3 g o x: x: 
8 c c o o 
u o .2 ^2 

5=§ § S S 
U ° 8 E s 

« •S "° fc> fc> 
^ o o fc b 



5 
.5 

"8 

.5 
o 



o. P. 



^ 5 

i 1 " E S S 

S o ° 

8 j3 ° 

a ^3 <° .5 .5 

0 c g c c 
o JJ o o 

Z 3 8 3 3 

1 — m ■ 



■a 

c 
o 



3 
UJ 



u 

00 



o 
cs 



c 



r- 

Ov 

cs 



cs 
i 

cs 
r- 
cs 

cs 
r~ 
cs 

? 

o 



o 

=3 

,P 



U 
C 

E 



3 3 



o 

Ov 
Ov 



-a 

3 



a. 
•c 
o 

v> 
C 

cj 

"o 

o 
J= 
o 

00 



o 

Ov 
Ov 



OO 

p 



s 



c 

o 



3 tE 

8 UJ U 
to C 

g u 8 

E fi "2 



— . 13 

g 2 
.2 O 

« -a 

Z cs 

n oo 
L0 cu 



ui 
O 

z 



CO 



c 

CO 



23 

d 

ERIC 



la 



•g 68 

CM (sj 



£ T3 68 



•g 



OQ 

*1 



o 

-g « 

o o 

si 



CM - P 



- 00 
CM O P 



00 >— — 

^; — ^ 



on ST"^ 

CM-Sg 
O 



. 00 



as — ^ 



o rr^ — 
no — 



O ;— CM 

in cm oo 



o j^co 



• US 



co — 
O 



no ;T~ — 
_j ^2 in 
t — t~ 
O 



r— CM 

«-> ~ 00 



On -—CO 
• ~* CM 

CO •— ' 



43 

/— *5) 



CM — ' %f — CM — (sj 



NO J— 00 U1 ST 

• CO f"s] ' " 

CM - £ CM - 

O p 



oo on jr-oo 



CN— « _ CM — (sj CO — < (r) 

odd 



CM — NO m 

d d 



? CM 

• ■' cn 
<*> *■; 
o 



N£) g^O g^t~~ O g'NO 

d _h* d d _h* 



1/1 JT-NO ;— CM NO C 

• w ^ ^ * - ~ m 



O — wi 
CM _* — 



IT) CM 

d 



00 

oo c<-> 
rt d 



^JT'OOCM,"— 00OJ— 00 
. Ov n • >0 .— i • CO CM 
On — £ rf c4 S CM £ 

" d d ~ d 



OnCMUcOCNcsJnO— co 



. (*1 I — • C7N . — i . NO rt-j 

oo co cn—' C nVncMVf 



ON — Sn-!oN3Nm 

~ d d ~ d _^ 



00 iT-NO 



o 



CM CM ! 

d 



co r>ON 

• CM r-, 

co •* 1 



co*— O'*.'— t-cojr^vp 
cm — qC~- — vo M "^co 
d- P. P.- 



CM 



IT) 
CM 



CM 


o 

CM 


NO 
CM 


<— co 

— 1 rj- 
"1 co 


CM 


^ — ^ 
IT) 
CM 


00 


IT) 

CM 


' — * 
NO 
CO 


cn 


00 
CM 


^ — ^ 




O 






O 




d 

v ' 






d, 






d 




in 


[»■ 
CO 


NO 
CM 


P£ 

"I CM 


On 
CM 


y— 


cn 

NO 


NO 
CM 




NO 
00 


CM 




On 


o 






o 




d 

v ^ 






e 






d 

v ' 




y — V 
NO 




ON 
CM 




On 
CM 


^•00 


00 
CM 




o 


CM 




CM 
NO 


d 

-■ — • 






d 
>^ 




o 

V — ' 






d 
* — ' 






d 

v ' 




So 


co 
co 


co 


;— ON 


ON 
CM 




00 
CM 


00 

cm' 


in 


ON 
NO 


00 
CM 




CO 

<n 

CM 


d 






d 




d 

v ' 






d 

v ^ 






d 
^ — ' 




'—00 

= 5 


r- 

CM 


0 o 

1 ON 


ON 
CM 


' — ^ 


O 00 


^ — * 


ON 
CM 


00 
CM 


o 


00 
NO 


o 








© 

N — ' 




d 

v ' 






d 

v ' 






d 

- — - 





^0 



S 2 <=> 

CM ■ ^ 



CM zr-c" 1 cn ^ — 

d2S°°"£°° 
^d -d 



NO 

"* d 



00 t — ~— 



CM Ot— — CT~On On CO '— NO IT) ^On 

• ovjfi r- en no ._• 2 oo , • — ««• 

On •-' 



On— <(sjNOCMi5NOcn 

~~ d w d d 



• CM r-~. 
On cn 



On r— 



2 - 3 
o 



. m rt •ifltt -On,* • 2 no 
oocM^OcM2>n — rtmmii 



ONNOr— ooiri'— •ONCO'T-cn 
t~~-^-„iocM CN ^rrMi;c<irn r si 
H d ^d ^ d "*d 



cm i— in in ;— O cm <T>on oo r^ — 

.tJ-q .ONvo •NO(v).CM 0 o 
On — ctnNO — vgm — 

d ~"d o "d 



' ^ 

. O 
NO CM 


CM 


CM 


£—00 

co 

~ CM 


CO 
CM 


CM 


o 

CM 


oo 


.09) 


IT) 

cm" 


CM 00 
CM 




On" 
CO 


CO 


.—i ' — ^ 
. NO 
CM CO 


r—t 


d 

v ' 






O 

v ' 




s 






o 

v ' 




d 

v ^ 




d 

v ' 










NO — 


00 


CO 


CO (M 
— CO 


oo 

CM 


^ — * 

CM 


CO 


IT) 
CM 


J— ON 
CO 
— CM 


00 
CO 


'— CO t-~ 
CN CO 


CM 

CO 


NO 
00 


•* 


/ V 

NO 

CM 


On 


d 

v ' 






o 

v ' 




d 

v ' 






O 

v ' 




O 

v ' 




d 






d 




p 


NO 
CM 
CM 


IT) 
CO 


CO 


CM 
CO 


in 

CM 




CO 

co' 


CM „ 




ST oo 


o 


^ — ^ 

ON 


o 


iri 


On" 
CM 


CM 

NO 


d 

v ' 




o 

- — ' 




d 
-■ — 






d 




d 

- — - 




d 

-■ — 






d 

v ' 




00 '— 

. in 

t~~ CM 


»— ( 

en 


CM 


r— cm 

^ CO 
— •<!■ 




o 

CO 


CO 
CO 


o 


CM ^j. 
CO „ 




CO , — i 
CM jsj 


ON 
IT) 


^ — ^ 

CO 


ON 
NO 


NO 
NO 


' — ^ 
CO 


CO 

vr> 

CM 


d 

v ' 




s 




d 

v ^ 






d 




O 

- — ' 




d 

v — ' 






d 

v ' 





f- i— 00 

CM" 2 5 
o 



NO 

cm' 



0 . ON vo • S (SJ • CO oo 

— * — - i<n « ^ i/n n (£, 
d 



— ON "* 



' 

— NO 10 

d d. 



o 
o 



1 II 



o 
2 
a. 



Z 



Z 

"8 



J3 

00 to 



v- « -—'3 S -— S j> -— 



S « v> S o 
> 3 



z 

oo 
o 

4) ? 



3 i 

8 § 
.I* 



i 

e 

8"' 



C 

- 0 § — 

CO C3 « 

c 3 
pa rt 



Z ^ Z 

"8 i "8 

•2 

.SPS 

II 

• 3 00 N 
C 

pa 



Z 

■8 



J2 
00 IA 



00 _ 

^ 53 ^ '— d 5) 
pa < 



Z 
1 

00 

rl 



9 

ERIC 



24 



CO 



H CM 



•a t£ 



•a 

3|Q 



'E £ 

U' 



d " o © 



m cm 



: cn 



CMCM^CO-HfoN'-cM^I — 



°°. So s °: o g; °°- ^Sg ^ 

o o o 



CM 

a 



cm 

o 



'5 



<=> ~ o 



d o ™ o 



X- 3 ~ 2 ■> S R ~ q 2 



o^'itq m t q n S ^ " 



CM 

d 



<m 00 



2 « 2 § £ p: § S - R * 



0\ u-i 

— d © M o 



CM 



© © .2 © w> 
~ d ""p. 



roa>c-pts^pc^ 

H a a- -a 



d p, a 



' -O -< fr| — 1 — i 



d 



o o o 

w * — k 



d d a a 

5 £ * vd a a « a s n * ° 

d o o o 



oo eo 
d 



3 °~S^o 
d P« p 



3° 
< 



Vt 

Z 



.;?>/"> .EPo\ 



U5 

z 



Hi 



o o 



CM 



o 

CM 



c— '—•cm „ j~' vo 

^ K> CM ~ — 

o o 



o o o 



m—PJcM — mCM-^, 
d o o 



* CM 



cm sj-oo Ox ci 
d p. P. 



to 'j- co 
rsi 2 ^ 



cmS^cmSScm 

a- a- 



ScmSR 



04 a a 

oo— ■!£ir>CMcsmcn 
^ d ^ P. ^ O 



fi STS °5 P2 °5 cm 2 

^ a a s 

^ d ^ d ^ o 



o a—" ^ S 



— o S ° — 

d p. 



ro 



. oo 5> 1 . \© <j\ „• °° *o 
d o a 



o^rX'CMU-iir-qNcn'jcv 
d -h* d ^ o 



Z 

•3 



z 



1 « 1 



«,gSi,§ 8 .2 



Is 



08 • 

8° 
> 



5 JB o 

w>S£ g 



od 



en 



z 



a 
o 
oo 

£• 
o 

t 
8" 

ex 
u 
u 



u 
.S 

•s 

•o 
_2 

.S 



s 

'5 
o 

60 

.52 g 
S o 



3 

•o 



E 
S 

w 

V) 

< 



o 

'3 

2 
o 
o\ 
o\ 

•o 
c 

M 

•o 

I 

•c 

o 



o 
o 

00 J= 

2 .8? 
o o 

CM 2 
CO ^ 



CM 

CM 



1 'J" 



c • 



c o u 

I .8* 

N to C 

.3 o o 

8" 8 3 
"3 ^ ^ 

g </i o o 

•| g^S 

o .ti to to 

>| S 8 

"c "° 'S "* 

« ^ c c 

.£M! 

■a E « o o 
e a ° > > 

o Q. e o o 
o " «2 
« & -3 "3 « 
^> o « 
»a c - 

a « S3 

o ^ 



CO 

°i 

CM 
1 

00 

\o 

CM 
00 

<o 

CM 

o 



3 3 

E E 



£-° O MM 



| 8 8 

O to to 



'55 
«2-S -S 



oo 
I 



3 
•O 

U 

O 

c 



J5 - 



^ z 



« -5 



H 

M 

3 

oo 
c 

e 

a 

o 



to „i 
O J3 
J= '5i) 

oo 

3 U 

o c S c c 

| t/5 CO W W 
1^- N co ir 



s 

CO 

c 

.2 o 
•o c 

.O co 



E S 



u 

•c 



g 2 



« -5 

Z CM 



os a 

D oo 



25 



ERIC 



V 




8f 

■■3 

s 

Z, 



s 



■a 
§ 



I 

■a* 

c 

o 

•■a 



e 



T3 S 

2- 

sl 

g § 

•2P 2 
IS 3 

2 c 

3 § 

"8 3 

Sa- 
ls 

81 

O O" 

1 8 

h 
|e 

15 

05 

H 



H CN 

'■6 

o 

(X 



"2 ^ 

<N & 



J* 
03 

_ a 



•a 



I* 



5 1 



(2 a 



T3 t& 



•O 

*3 



tJ in 
o cn 



2 
_ o 

9 ! 



.2 'C 

o o 

r i ^ 



mo- 

CN^ 



NO O On 



00 — i on 
_S »-« *■*• 



o — t- 
„• — 1 oo 

^ d^ 



cn o !=; 



. CO t — 

S3- 



~ sen 



■ •— < r — 



tn -~- on 
„• 55 ^> 



Tf -< P 



• On CO 
m ~ g2 



• O r — - \£) > NO cn 
CN — ' ^ CN — ' CN -h Js) 

odd 



• P^ o • no : *^ O 

d o o 



O O O 



~; ^5 2 00 ~ — © 
odd 



m jr-vo m '"■in o 



: o 



o 



o _r 



O— 'KiflN^oonM 

N p ~d rt d 



.ing.Ovo-^o 
d ~ d *^ d 

d d 1-1 d 



o ?^on oo ir-cn 

o rt d ~ d 



oo c> \o o\ JT 1 
o o 



ON 



in eo -r-m 

^- • On o 

no — 
o ^ 



oo ■ 



2 no ^; 

< ^ NO f^l CN 

> d 



NO-t^m 



^>ND NO C-O O 
-^tnNO^H^tn-^cn 
d O O 



• no •— i • r- o • oo no 



• •— 1 o\ • ^~ oo • On o 

odd 





<n 

(N 


o 


o 


"1 o 
(N CS 


o 




2 1/1 


On 
CS 


0? 


t — 
«— * 


d 




o 






o 






d, 




d 

* — ' 






cs 




tn 
(N 




NO 


NO 
NO 




00 
CN 




in 


d 




d 






6 






o 




o 






00 
(N 


^ — * 


NO 

On 


O 

pi 


oo 


tn 


r~- 

(N 


,-T~ON 


00 
(N 


^ — s 
CO 


O 


d 




d 






d 






d 




d 






On 
<N 




NO 


CO 
(N 


NO 


rt 
00 


o 




O 

pi 




CN 
CN 


o 




d 






d 






O 




o 




.10) 
466 


t~- 


^ — s 


00 
00 


00 




NO 




*^ ■* 


ON 

CN 




ON 

m 

NO 


o 




d 






d 






O 




d 





• "n m 
On — " _ 



ON CN 

rt d 



On PI 



2 ■* 
o 



CN 



CN 

O 
CN 



< CO 



. f» o ■ 5 o ^* S 



m no cr- 



•h m o •"•no rj- (Z>>rt —i ■ 
• CNro ■ • — 1 -Via j ™ V) 
ONCN C N t ^' rJ '=< v1CN) volr !'-< 
"- 1 d d H o d. 



00NS2NOm^i^CNl«'*mL 
rt o rt d rt d. ^ P. 



• t^vn • NO no -Or^ • C 
C~P1^;mCN„TtCNi_CnP1cN 



— 'C^-^t^^-'i-CN.'^-PiOrr-ON 

^: ?5 00 2 nN ,^ *2 t- , • )g m 
On-— looNOCNlvflin^^i/IPlvo 

"d p rt o ^ d 



pi ^ ^ — 1 



^ — s 

w> 

t— < 


ON 


00 
1 — ( 


<=> 
"* pi 


CN CN 


O 


in ' — • 

. NO 

pn CN 


m 
m 


NO 
CN 


* — s 

cn 




o 






o 


d 






o 










in 


PI 
»— 1 


in 

CN 


NO (S 

CN 


PN CN 


NO- 
NO 


On 


, — ^ 
cn 


m 

On 


CN 


, — * 

On 
PI 


m 


o 






O 


d 






d 






O 




, — V 

PI 
CN 


ON 


— 1 'T-NO 
• g ON 


PI ^P1 

- On r-^ 
it N ^ 


. — ■ ^ — s 
. On 
m CN 


On NO 

Sin" 


PI 


o 
t~ 


d 






o, 


O 






o 






o 




c? 
PI 




l> 

pi 




°i(o 

^3- CN 


00 


in 


CN 
CN 




NO 


r — ^ 

PI 

p-> 




o 






O 


d 












d 




, — V 

PI 


NO 
NO 


NO 

ci 


' — ' T^- 

NO CO 
— < 00 


" 0? 


CN 
NO 


o 
in 


^ — ^ 

in 


cn 


ON 


^ — * 
pi 
p-> 


On 

m 

NO 


d 






d 


d 






o 






d 

^ — ' 






S H % « « ^"S 
See 



Z 



n p 4) 



z 



CO 



■J, a - • ■- 



o 
< 



a 

ERIC 



26 



«3 



8 

3 



T5 
C 



T5 

s 

1 

o 

3 1 

o e 
> .5 
-*-» 

c c 
— o 

8 V 



T5 ! 

en , 

J. 
u 

VI 

en r 



3 

3 

T5 

<U 

§ 
9 B 
« 

ll 
SI 

<~ 3 
O O" 

JQ o 

a w 
3 "* 
c c 

68 
> 

•< 
i 

©\ 

H 



«2a 



•a S£ 

3*8 

o 



•a 6R 

05 



|2« 



•a 



••g ^ 

03 

S2 

- s 



5** 



•a 



•a a? 

3 a 



i3 



o 

S to 
3 C 
3 ^ 

o o 
•C « 



U 



„ m N * M 
O 



^ ^. — 5; CS ~ £ 

d p 



p 



CS CI ^ CS — CS ~ S« h .h 

d © © p 



•_ ^ , w -~-ly-> on £T-CS Ov (T-<X> 



©g-cso 

o tN 

d d 



ON 



^ -5 ^: O Ov ^: 5 m • O m 
— ,i cs ~ 00 N « crits — r~ 

d d 0_T © 



- d * d ^ d 



' d N 6 



' d 



iy\ v r-^ o /— \ *— « r-^ *■"■*■ O C^l 



O 
""' d 



cs , 



~" o p. p, 01 © 



d ~- © o « " p, 



, l« ^ CN ~ ~ — £ 

d d o 



^ lO CS m CI "— 1 t*1 

d d. 



vo 



oo 



. ^ t+ • 1 no • ^ csi rClj^ 



(M 'res O ** . 



■•cs m -r^oo 



^ b\ ^ vo ^3 "". on fy; " : 
d d d d 



CS — <S — ^ 

d d 



r-^ /— \ r-^ l/^ O Tt" i 

cs — !§cs— 'Snn 



• CS . ^ m • 2 00 
tn — t^CS — f^CS — 



m o\ ^in •>* s^oo 
• ^2 oo ^; ^ ^ ^; S M 

CN — (vjCS-^t^CSCS^-i 



d ^7 d _T d 



m is • cs Sn 
^ o - d 



^ d "~ d d. 



oo— i^iriCSJ^cScn 
X « d 



\o '-vrt \o rr- io if) oo 

t^CScM'^CSt^CS'T— i 

d. d. " d. 



• ^o „ ■ in ; 2 00 



. oo • oo u< 



ON 



odd. 



o vo C v " _l vo c n 
d d 



. r- oo • no vo • ' cn 
d d p. 



ooci2<vn — oo n r< —■o l> ir)p_iON-< (S 
P. p p. p" O « P, 2- 



t/3 

z 



t/3 

z 



1 

o 
o 



Z 

w ON *^ C\ Q 
X) On On J S 

op • op • op H 



t/3 

z 

2 

Op 

-'53 



S2 
1 

" Ov 

a ci 



Z 
1 

00 ov 



Z Z 

"So "3 

00 c oo 



a-u?ij)#iuJ,r«? gci 



/->.'o3 v7v /— v to 
o 5 r~ u ? o 
£ § o ^2- § g -id 



a. 

3 

2 

oo 

£• 

O 
«-» 

2 

a 



u 

o 
o 

u 
.3 



•o 

3 



3 



8 



CO 

J i 
•s-s 

• 2 o 
: g a 
! S u 

I " o 
o. c 



» "2 

■S g 
■a 

3 o" 

«o o 

„ c 

« .2 

'o o 

o » 

(A 

. Vt 

« « 
o E 

(A C 

o o 

s s 

>> >> 
o o 



o 

So cs es 



o j2 , 



_ Cu 
« 3 C 
a o u 

2 « S 

a. 



?! & 



3 



00-j t. 

a ° 12 
c J2 

" § S 

I CO CO 
In n 



o o 
oo oo 
o u 

« « 

o o 

to V) 

.2 .S 

CO (A 

c c 



00 



Ov 
C-4 
I 

CO 

vo 

tN 

00* 
VO 

O 



oo 
c 
E 



CD 

t 

» 
3 

a 

lij 
H 

o 
z 



3 



E 

CO 



Z 
o 

ON 
ON 



c 
•n 

o 
c 
2 
H 

"o 
o 

o 
w 

1> 

ir 

o 

Ov 
Ov 



2 S 

ci g- 

tN S 

on S 

tN .2 



3 

•o 
tu 



s z 

c c g .2 

^ o .S2 

> > 



EE ? -2 



3 

Vi 

c 

•2 6 
E 



O (A 

g< 
O o 

— T3 

g e 

z « 

D 
° # 



oo 



rY5 



27 



0 

ERIC 



3 
•a 



5 

E 
ft. 



jQ 



8 



o 
•a 



m o 

ll 



1- 



4> 



► 



U 



1 
o 

V 
i 

.3 ; 

1 
u 



"2 * 
J* 

»— * w 

«— 4 4) 

51 1 



e2» 



3 

8 

-a 
« 



> I 
a 1 

1 
u 



f * 

CQ 

10 



to 

•c 

C3 o 



* 0 00 

cm — t- 
d^ 



cm - £ 



00 £>t- 
cm8£ 
d 



<N ~ £ 



<>So 

cm - 



§8 



25- 



00 — p 
d 



2 2 cm 
i2 1 r- 
o 



5&g 
d 



. vo vo 

^ O 



CO JT-00 

d 



co 



VO 



*"> r- 
o 



0\ 

co <-> <§ 
d co" 

10 

z 
"8 

60 



~ :: *o Pt- 

p. p. 



On £^in ^ 
• CO • O fY-i 

cm — J?, cm — ■ V+ 
P. P". 



©PSS^-oS 

P d 

• CO p»» • 1 o 
CO ^ pi (S —I ^ 

d d 

v # v ' 

°i 6> 52 ^ ST 2 

N iS 5 N ' ° * 

d.~* P-- 



~ d d. 



m IN ^ VO ^- ^ 

d ~ © 

v * v ' 

•«* CM to m co ^ 

~ d. ~ a 



vo »— ^ r- — vo 

~ d _: ~ d 



* CM «— 1 : vo 
CM ~ n- CM S 

O O 



CO CM J55 CM — ^ 



°°. 5^2 ■* PS 

"* — CO "* -1 Tt 

o p. 



00 o — 1 vo 
m cm tr, m cm ^ 
d d 



— 1 00 r>vo 

. CO • CM 

^. to — < vO 



O ^ 



o _r 



00 



J3 
00 



u w 3 S w S 

00 



VO O vo I I CM 
CM . VO w 
O 



>ov r- 

CM 



(Mm 1 



VO 
CM 



?r-o O ^>mo 5^ co 
^-■Jcocm^cocm 



« ov r^^P ts 5^3 
d 



. O S vo «s Ov 
cM-^inCM^i-!co*- 



svq 

CM 



>CM 



tN — ^CO^^jCOCM^ 



vo -r^vo o fT-o co 00 ^>oo 
cmSS^^^^^c^^^S 
o /vT d d o 



m iT-oo 

ovSjg 
*"d 



- cm g 



00CMvo o,m t ^- v } w 



irtcM^t-cMSt-in^ 
1-1 d ^ d ~ d. 



cocMTj-inmcsinTi-^ 
^ d ^ d. " d. 



""dfsT^d rt d ^ d 



co C^oo 
CM O vo 



*ON CO 
CM 



cm m 



-vo 
CM 



T"CM 



CO^v5CMCM^CMCO_ 

odd 



OO'T-00 00'r-VOCJV^'* 
• Ov • * CM • CO vo 

Tt — D-jCOCOijCOCO^ 

odd 



CM 2>0 CO r- CT'Ov 

VOCM^mCMf^TtCO^ 



Ov S^VO CO 2>Q Ov iT"in Ov rX'S 
co^^rtcM5(0-- l J4cMvo!=; 

0 n" d d d 



T3 



60 5 



.ST O -S 



z 
"8 

«-* 

00 



Z ■« 

' 1 

00 o 

oq ac < 



z 
"8 



J3 
00 

'53 

M * 
CO S 



^34 



28 



9 

ERIC 



■a 



6 
« 

E 

a, 



8 



li 

-1 
!<? 

o 
•a 



•S 3 

SI 
S'C 

3 4> 
T3 _ 

2 2 

9S a 



■S "2 

«5 _ 

00 J- 



3 

a, 

1' 



"3 



2 $ 

I 1 

e 



► 



8z 
1 



"IS 



•g t£ 
pa 



g tfc 

I* 
I* 1 

■ 

53 
a 8 

«1 



Pa 



CN 



•g ss 
3$ 



<V, 



■c 
•8 2 



to o 



■* ;« 00 



o 



CN — ' v cn — ■ cs 



ts — ■ J-2 co ri 

p. p, 

a 



■ ^2 on 



oo 
c4 



P. P. 



T v -< oo ^oo 
X^odS^ 



^ \r> cn cN 



—i £>on co fT-P"- 

• 00 po • ON 
tJ- en Tf Ol j£J 



v> cn ^ in cn r=- 
~ p' 



T**-" 00 *00 

<n cn r 
d 



(O 



tj- cn ^ m cn cs 

o d. 



cn ^ OS p g~P~ 

vd co £J vd cn JC) 



• co S • t» o 
<s S "i ^ P- 



en oo 



oo c^— 1 

p. 



ON CN _< 



-~.00 

vo r~ 
cn 1 "* 



o 



cn£ 
© 

— -~-00 

vdiQ2 

*"" d 



IONS 



f- oo 



-vo 

cs = 2 



o. 



in ^> ro 
■ co oo 
in cn S 



CO — • 

d 



CO 
00 



CO 

CS -« CO 



CN 



co cs 
1 CN 



CO H 



CN cs 
P.- 



00 JTOO 

• ov r- 



00 CN CO 



. CO fsl 

vo CN cN 



CO 

• CO vrt 

>/l co JS 



oo cs 



N -1 
o 



r — ' — * co 
CN CO 



rj- CN ro 



r) oo 
• "1 vo 
«1M„ 



. co 




J* 

00 



CO 

•o 
c 

09 



I 

r~ 

Ov 
(N 

VO* 
ON 

CS 
I 

CS 



03 

E 



eg o 

i 5 

's-s 

JJ s 
3 .s 

^'5 



8-s 

00 o 

! § 

0 o> 

1 H 



c 

! 

•O 

id 



c 
u 

E 



4! 



c 
o 

"S 

Z 
o 

s 

•o 

•c 

o 

to 

c 

H 

"o 
o 

X! 
o 

■a 

o 

ON 
ON 



3 
•O 



CM Z 



CM 
CM 



03 
3 

c 

di 
H 
O 
Z 



j 5 



c 

•a 



3 
co 
c 

W o 

.O (A 



U o 

-5 



? 'I 



c u 
.9 U 

z§ 
S a 

co Q- 



29 



0 

ERIC 



1 

XI 



s 

w 
3 

1 
© 

8. 
a 



•a 

§ 

1 
© 



2 -g 

1| 

* § 

if S 

xt S 

3 XI 
-1 

In 

5 "o 



42 

'! 

Cm 

© cr 



e 

4> 



< 
I 



4> 

3 

H 



9 

ERIC 



•g 

las 

O CM 

5 8 



H cm 



"8 



•g 

I as 

CO 



5 § 
^2 



H cQ 



•a tR 

£ 
o 



•g 

"3 



o t£ 

CQ 



C/3 O 



2.6 
(0.10) 
776 


2.6 
(0.12) 
439 
2.6 
(0.11) 
337 


2.6 
(0.10) 
666 

(-) 
13 
2.8 
(0.22) 
34 
2.8 
(0.19) 
59 




2.7 
(0.08) 
774 


2.9 
(0.12) 

339 

2.5 
(0.08) 

435 


2.6 
(0.09) 
625 
2.5 
(0.32) 
41 
3.5 
(0.26) 
64 
2.7 
(0.37) 
37 




2.8 
(0.11) 
751 


3.0 
(0.13)) 
315 
2.6 
(0.11) 
436 


2.8 

(0.13) 
520 
2.9 

(0.16) 
108 
3.2 

(0.17) 
83 
2.5 

(0.16) 
32 




2.9 
(0.09) 
822 


3.1 
(0.!3) 

349 

2.7 
(0.10) 

473 


2.7 
(0.11) 
397 
3.0 
(0.12) 
247 
3.0 
(0.22) 
137 


1 T-vo 
1 | CM 




2.7 
(0.08) 
3,123 


2.9 
(0.10) 
1,442 
2.6 
(0.08) 
1,681 


2.7 
(0.09) 
2,208 

2.9 
(0.13) 

409 

3.1 
(0.16) 

318 


2.8 
(0.19) 
154 




19.5 
(0.15) 
776 


19.3 
(0.15) 

439 

19.9 
(0.20) 

337 


19.4 
(0.17) 
666 

(-) 
13 
19.7 
(0.64) 
34 


20.1 
(0.33) 
59 




17.4 
(0.16) 
774 


16.6 
(0.16) 

339 

18.1 
(0.22) 

435 


17.2 
(0.19) 
625 
19.2 
(0.53) 
41 
17.7 
(0.57) 
64 
19.2 
(0.34) 
37 




16.0 
(0.18) 
751 


15.2 
(0.22) 

315 

16.7 
(0.21) 

436 


15.6 
(0.20) 
520 
17.3 
(0.38) 
108 
16.8 
(0.63) 
83 
16.8 
(1.1) 
32 




15.0 
(0.20) 
822 


14.3 
(0.19) 

349 

15.5 
(0.24"> 

473 


• ^ rr\ • CO tJ- • Vo m 
~ O O ~ O 


1 | CM 




17.0 
(0.14) 
3,123 


16.6 
(0.15) 
1,442 

17.4 
(0.16) 
1,681 


14.2 
(0.17) 
2,208 
15.9 
(0.23) 
409 
16.9 
(0.48) 
318 
18.5 
(0.86) 
154 





CM ~ p 



C^l ' — ' f — . 



VO ~ 

^ . P- 
O 



, ■ r2 CM 
«■> — ; oo 

o 



o\ ^~-CO 
r^i ' — 1 , — i 



1 
op 

«2 



K ; 2 " J 2 n 
cn rj- ^ ; co 

d p. 



• ^ t n • ^ rn 
ft co m ~ •«*■ 
O p. 



« N n ^ rt 



in <N ^ >/-> 



— < ,J CO — ■ vo 



CM iT-vo 
CM < vo 



cm co 



OK 

CO 



o © 



• ^ CM • VO ^* • O vo 

cn-vo N( ^ Nri 

d d d d 



i^to" 

cm r» 



■ vO ro _■ c^ o ■ oo ■ 
© d d p 



J^CM 
CM to 



»t— 00 



VO ^ 



vOCMfo-frCMts^f)— . 

odd 



-vo 
CM 



o ^ 



g 1 o 2 °^ £T 

" ■>*• CM to cm r- 



^1 ~ v > 



Z 

•8 



z 
•8 



43 
00 



JS 

.2? . 
«5 ? « «5 ? 



o o 

S 13 



a> 

j? 9 



c« 

k2 



OS 



» 3C S 

Op § M 

6 ? . ti ) '5 ij 
2C 



•8 



C/3 



O 

43« 

00 o 



Z 

op 



30 



8 
c 



Cm 

25 



o 
w 

<u 

■a 

c 

o 

S5 

<y 
a 

§ 



§ 

1*8 

83 3 

O O 
•3U 



> OS 

l-S 

OS — 

g.g 

X! U 

Is 

X) CS 
"S "33 

If 

<M 3 

o er 



b 



41 
> 



^ -o *R 

^a 

o 

Oh 
5 



"2 * 

Its 

-! 

*1 



T3 



OQ 
*1 



a 



09 

S3 u 

< T3 



d 



^ o 

CS CS 



vo v© 0\ 
^CS-S 



CS — ^ CS — CS 

d d. 



CS CS £2 CS — CS 



00 VO S 

cs _. — ' 



m ccs 

• CS 
fs — CS 



^cs2 

CS — ; cS 

o 



oo jr^o 
cs^2 



CS . 

o 



°i o £ 
CS — # cn 

p. 



9in£ 
rn — ; ,_ 

d 



c 

.9 
« 

a 

.9 

3 
I 





cs 00 


2.8 
.09) 
,227 


d d 


o 


o _ 


j ^incspj* 

i ON CS 

~d 


18.9 
(0.27) 
195 


19.9 
(0.18) 
490 


16.5 
(0.46) 
46 
16.9 
(0.28) 
169 


17.5 
(0.19) 
242 


17.8 
(0.22) 
311 


15.6 
(0.47) 
67 

15.1 
(0.23) 

200 


16.1 
(0.15) 
219 


16.9 
(0.28) 
251 


13.9 
(0.43) 
123 

14.5 
(0.26) 

283 


15.7 
(0.33) 
190 


15.7 
(0.33) 
175 


15.1 
(0.31) 
251 

(0.21) 
726 


17.1 
(0.15) 
846 


18.1 
(0.18) 
1,227 




cs r>m 

cs22 


• cn on 
cs — ' !£■ 






d 


rt ^ rt CS 


cn — cs 


3.0 
.16) 
311 


d d 




© 




n .o2 

rt CS cs 


3.8 
.18) 
251 


d d 


o 


o 


vo * 2 >n cs £3 


o ~© 
incs2 


r-~ >--Nin 
. vo t-~ 
Tt CS 1_ 


© d 


o. 




On ^-s .— < o vO 


3.7 
846 


3.0 
.13) 

,227 


d d 

w * 


o 
— ✓ 


o ^, 



J3 
00 



5 "8 



ul as 

o 



2 

oo 



oo i 



15 



J3 

60 - 

<0 ? B 4> ? 



§ i 



•rt 00 

^ § S ^ 

MS 



"8 



00 



o 



s 



"a, 

e 

. a) 
<8 U 

s s 
je S 

2.1 
SI 

00 u 
O 4i 

ir 



op 
1H 



?5 
cn 

•o 
c 



<s 

CO 



°5 
<s 

CO 
ON 
CM 

I 

00 
vo 

cs 



CM 



10 

c 

o 

« 

u 

3 

•o 

pa 



c 

u 

s 

(A 

S3 

1/3 

to 

< 



c 

o 

z 

o 

ON 
ON 

•o 
c 



•o 

3 



a. 
•c 
o 

CO 

c 
2 

H 

"3 
o 
J= 
o 
co 

op 

X 
o 

ON 
ON 



00 

I 

*« 
c 

.2 

1 

s 



u 
oo 
c 

g 



c 

u 

E 



^3 

CD 
3 

ui 
H 

o 



c 
u 

E 



CD 

c 
o 



5 

c 

.2 o 

s £ 

3, - 



O o 
— T3 

CO CO 

c 

.2 O 

« s 

a: a 
3 oo 

o| 



AO 



31 



9 

ERIC 



gf 

'•a 

8 
p. 

z 



8 
1 



i 
1 

o 

•■a 



> On 

as 

i 1 



•5 73 

f 1 
3 X! 

a 



O o" 
4) V 



> 
< 

I 

s 

9) 

H 



Qu 

»1 



"2 * 

I* 

03 

3 i 



£a 



T3 t£ 

«*a 



"2 * 

a a 

oa 

5 8 



"2 * 



I* 

03 



< 1 



•c 

C o 

•S 2 

on o 



CM 



CM 



co 



0.10 
771 


cm 


(0.13) 
324 


0.10 
769 


t-; 
CM 


(0.12) 
331 


0.11 

779 


0\ 
CM 


(0.14) 
346 


0.11 
787 


CM 
CO 


(0.12) 
461 


(0.09) 
3,106 


Ov 
IN 


(0.10) 
1,462 


(0.19) 
771 


18.7 

(0.26) 
324 


(0.16) 
769 


17.3 


(0.16) 
331 


(0.18) 
779 


15.9 


(0.19) 
346 


(0.21) 
787 


14.9 


(0.14) 
461 


(0.15) 
3,106 


16.6 
(0.20) 
1,462 


(0.11) 
771 


vo 

(N 


*~ CM 

o 

* — * 


(0.13) 
769 


vO 
eo 


(0.16) 
331 


(0.16) 
779 


rt 


(0.17) 
346 


(0.19) 
787 


Ov 


(0.11) 
461 


(0.12) 
3,106 


O 


(0.18) 
1,462 



3 
«2 



Z 
1 



CM ~ ^ 

o 



CM fr, 



>VO 
CM 
CO 



Ov2$ 

"6 



£>oo 



• VO CO 
VO CM 5 

d 



^ o ^ 
m co 



^ ^ VO 

O 



rJ, !2 "> 

^ ~ 

o 



- CO 
CI 



■ ^ CM 



z 
"8 



z 
"8 



00 



_ .2? 



in ^-vo 
cm' — vo 
d 



CM CM 

d 



CM CM 

d 



vo -~»c«n oo -~- ov «-> S'Ov p- O" -1 

CM^SCMC^CO-S^CNCM^ 

d d d. P. 



00 jT^vo oo cr-t- o ;t-cm vo c^C: 

CM^ftCM'-'SwCM 



cm in 
d 



CN" — < ^j- c*^ * — ' , , c^i • — • _ c^i cn 

odd© 



£T- ■«*■ t— jr-voov-T-Q'—.Ooor^^oo 

si cMSa^-i-^s^-ss 



S CM 



co VO 
• Or — 
Ov CM to 



- d N d. 



f- — i f~ "* r- in ov •>* 
d ^d " d "d. 



^ cr-vo vo ocr ° <n vo c^r~ 

vOCM5^vOCO„t-Co' t~- 

' d " d ' d ^ o 



> °° " jS» ^ CM-~-Ov 

TtcM?(!incoSvocoi_;t--ov 
d ""d 1-1 d ^ d 

— JsvocM^t-cMrsoom^ 
" S <n " d ~ S, 



co -r> vo 

■ CM 
CM « 'vo 



>n <"> r^^o o c- — 



CM co 

d 



CM CO 

d 



VO CT-CO CO 

. CO (7v • ' 

CO <-• CO CO 

d d 



Ov C Ov 00 C " 

^ co' S ^ cm 3 ,ri 

d d. 



vo sr-vo cm c^t~~ ov -—-cm vo ,or~ 

TTCMi^TtCM^COCO^COCM^ 

d d d d. 



.CMfTN -OVoO '^CN ,vo 

mcM5 Tl ' c i'-« Tl ' r, 1'-< tNv0 . 



00 
co' 



^^^.•^S-^OO-NOcO 
— (Nl^CM^fCO — fN)CMTT« 

d cm* d - - 1 



O O 

ir 

o 



z 
"8 

00 

'53 .y 



» s 

z — 
"3 o 

eo o 

- •- M . 

Qu 



u 5 5 » 5 - d ! 5 'g u ? ft « 



z 
"8 

■*-* 
X! 
00 

■33 
c 

3 



*0 



32 



9 

ERIC 




33 

9 

ERJC 

ummmmmim 



Table 13— Distribution of public high school graduates across levels of vocational course taking, by selected 
background characteristics: 1990 NAEP mathematics assessment sample 



Student 




Vocational credits 






characteristics 


Fewer than 4.0 


4.0 to 7.9 


8.0 or more 


Unweighted Ns 


Total 


55.0 


34.5 


10.5 


3,061 


(s.e.) 


(1.77) 


(1.51) 


(1.07) 




Sex 










Male 


53.6 


34.0 


12.4 


1,445 


(s.e.) 


(2.13) 


(1.86) 


(1.46) 




Female 


56.3 


35.0 


8.7 


1,616 


(s.e.) 


(1.95) 


(1.63) 


(1.09) 




Race— ethnic it v* 










White, non-Hispanic 


56.1 


32.5 


11.3 


2,236 


(s.e.) 


(2.20) 


(1.90) 


(1.23) 




Black, non-Hispanic 


48.3 


42.4 


9.3 


440 


(s.e.) 


(4.07) 


(3.61) 


(1.76) 




Hispanic 


54.0 


37.2 


8.8 


255 


(s.e.) 


(3.89) 


(3.99) 


(1.67) 




Asian/Pacific Islander 


65.2 


34.8 


0 


108 


(s.e.) 


(15.74) 


(15.74) 


(0) 




Parents' educational attainment 










Less than high school graduate 


31.6 


47.2 


21.3 


244 


(s.e.) 


(3.04) 


(3.15) 


(2.79) 




High school graduate 


39.1 


44.1 


16.8 


708 


(s.e.) 


(2.28) 


(2.12) 


(2.13) 




Some postsecondary education 


55.4 


37.0 


7.7 


831 


(s.e.) 


(2.23) 


(2.18) 


(1.13) 




Bachelor's degree or higher 


69.3 


24.8 


5.9 


1,210 


(s.e.) 


(2.25) 


(1.93) 


(0.81) 





*The number of American Indians in the sample is too small for reliable estimates. 



NOTE: Percentages may not sum to 100 due to rounding. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 14— Distribution of public high school graduates across levels of vocational course taking, by selected 
background characteristics: 1990 NAEP science assessment sample 



Student Vocational credits 



did- 1 aVlCI lollCo 


Fpu/pr than 4 0 


4.0 to 7.9 


8.0 or more 


Unweighted Ns 


Total 


55.4 


33.7 


10.9 


3,123 


(s.e.) 


(1.67) 


(1.40) 


(1.16) 




Sex 








1,442 


Male 


54.1 


34.0 


11.9 


(s.e.) 


(1.86) 


(1.65) 


(1.27) 


1,681 


Female 


56.5 


33.5 


10.0 


(s.e.) 


(1.90) 


(1.79) 


(1.34) 




Race-ethnicity* 






11.3 


2,208 


White, non-Hispanic 


55.9 


32.8 


(s.e.) 


(1.90) 


(1.61) 


(1-43) 


409 


Black, non-Hispanic 


51.7 


37.2 


11.0 


(s.e.) 


(3.80) 


(3.41) 


(2.14) 


318 


Hispanic 


52.2 


36.9 


11.0 


(s.e.) 


(3.47) 


(3.15) 


(1-83) 


154 


Asian/Pacific Islander 


68.9 


28.1 


2.9 


(s.e.) 


(12.60) 


(13.50) 


(1-35) 




Parents' educational attainment 










Less than high school graduate 


29.4 


40.2 


30.4 


251 


(s.e.) 


(3.34) 


(4.03) 


(4.55) 


726 


High school graduate 


35.9 


46.5 


17.6 


(s.e.) 


(2.46) 


(2.22) 


(2.33) 


846 


Some postsecondary education 


58.0 


33.9 


8.1 


(s.e.) 


(1.97) 


(1.77) 


(1.22) 




Bachelor's degree or higher 


71.2 


24.2 


4.5 


1,227 


(s.e.) 


(2.13) 


(1.72) 


(0.78) 





*The number of American Indians in the sample is too small for reliable estimates. 



NOTE: Percentages may not sum to 100 due to rounding. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 15— Distribution of public high school graduates across levels of vocational course taking, by selected 
background characteristics; 1990 NAEP reading assessment sample 



Student 




Vocational credits 






characteristics 


Fewer than 4.0 


4.0 to 7.9 


8.0 or more 


Unweighted Ns 


Total 


54.5 


36.0 


9.6 


3,106 


(s.e.) 


(1.96) 


(1.53) 


(0.84) 




Sex 










Male 


52.9 


37.0 


10.1 


1,462 


(s.e.) 


(1.93) 


(1.44) 


(0.91) 




Female 


55.9 


35.0 


9.0 


1,644 


(s.e.) 


(2.33) 


(1.94) 


(1.07) 




Race-ethnicity* 










White, non-Hispanic 


55.2 


34.5 


10.4 


2,256 


(s.e.) 


(2. 12) 


(1.69) 


(1.05) 




Black, non-Hispanic 


46.5 


44.5 


9.0 


400 


(s.e.) 


(4.10) 


(3.33) 


(1.82) 




Hispanic 


53.4 


39.8 


6.8 


288 


(s.e.) 


(4.30) 


(4.3i) 


(2.02) 




Asian/Pacific Islander 


73.4 


25.4 


1.2 


138 


(s.e.) 


(9.24) 


(8.13) 


(1.18) 




Parents' educational attainment 










Less than high school graduate 


30.8 


48.7 


20.5 


257 


(s.e.) 


(3.67) 


(3.53) 


(2.63) 




High school graduate 


38.0 


46.6 


15.3 


737 


(s.e.) 


(2.19) 


(1.94) 


(1.47) 




Some postsecondary education 


54.7 


37.7 


7.6 


805 


(s.e.) 


(3.27) 


(2.42) 


(1.51) 




Bachelor's degree or higher 


69.6 


25.6 


4.8 


1,239 


(s.e.) 


(2.32) 


(2.02) 


(0.65) 





*The number of American Indians in the sample is too small for reliable estimates. 



NOTE: Percentages may not sum to 100 due to rounding. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 16— Distribution of public high school graduates across levels of vocational course taking, by curriculum 
characteristics; 1990 NAEP mathematics assessment sample 



Curriculum 
characteristics 



Vocation; ,1 credits 



Fewer than 4.0 



4.0 to 7.9 



8.0 or more 



Unweighted Ns 



Total 

(8.6.) 

Curricular specialization 1 
College preparatory 

(s.e.) 
Vocational 

(s.e.) 
All others 

(s.e.) 

Compliance with A Nation 
at Risk recommendations 2 
All requirements 
(s.e.) 

English, math, science, 
and social studies 

(s.e.) 
English and math-' 

(s.e.) 
English 4 

(s.e.) 
All others 

(s.e.) 

Academic credits 
0.00-11.99 

(s.e.) 
12.00-15.99 

(s.e.) 
16.00-19.99 

(s.e.) 
20.00 or more 

(s.e.) 

Mathematics credits 
0.00-1.99 

(s.e.) 
2.00-2.99 

(s.e.) 
3.00 or more 

(s.e.) 



55.0 
(1.77) 



82.3 
(2.40) 
2.5 
(0.68) 

61.0 
(2.02) 



77.9 
(3.98) 

74.4 
<2.75) 

45.5 
(2.71) 

38.7 
(3.23) 

37.9 
(3.45) 



2.6 
(1.41) 

20.8 
(1.67) 

65.1 
(2.80) 

93.8 
(1.61) 



22.7 
(6.92) 

31.4 
(2.17) 

63.6 
(2.16) 



34.5 
(1.51) 



16.3 
(2.14) 

57.6 
(2.75) 

36.5 
(1.94) 



19.7 
(3.53) 

23.2 
(2.26) 

46.3 
(2.00) 

42.9 
(3.04) 

41.6 
(3.34) 



27.6 
(5.10) 

59.7 
(2.38) 

33.4 
(2.62) 
5.6 
(1.35) 



47.0 
(6.24) 

42.8 
(2.97) 

31.5 
(1.84) 



10.5 
(1.07) 



1.4 
(0.51) 
40.0 
(2.71) 

2.5 
(0.54) 



2.4 
(1-11) 

2.5 
(0.93) 
8.3 
(1.80) 
18.5 
(1.96) 
20.5 
(3.67) 



69.8 
(5.30) 
19.4 
(2.33) 
1.6 
(0.49) 
0.6 
(0.55) 



30.3 
(8.35) 

25.8 
(2.82) 
4.9 
(0.91) 



3,061 

1,076 
656 
1,329 

483 

870 
603 
434 
671 

145 
880 
1,309 
727 

81 
624 
2,356 
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Table 16— Distribution of public high school graduates across levels of vocational course taking, by curriculum 
characteristics: 1990 NAEP mathematics assessment sample— Continued 



Curriculum 
characteristics 



Vocational credits 



Fewer than 4.0 



4.0 to 7.9 



8.0 or more 



Unweighted Ns 



Highest mathematics course 
Trigonometry or higher 5 



78.3 
(2.28) 

59.6 
(2.37) 

45.2 
(3.54) 

29.1 
(3.01) 

24.4 
(2.86) 



20.7 
(2.28) 

35.8 
(2.19) 

44.3 
(3.22) 

48.1 
(3.62) 

43.4 
(3.13) 



1.0 
(0.35) 
4.6 

(1-0) 

10.5 
(1.83) 

22.7 
(2.75) 

32.2 
(2.86) 



1,067 



(s.e.) 
Algebra II 

(s.e.) 
Geometry 

(s.e.) 
Algebra I 

(s.e.) 
Less than algebra I 

(s.e.) 



769 



472 



317 



436 



'students eligible for both college preparatory and vocational specializations are included in the college preparatory group. 
2 See text for a complete description of category definitions. 

^Students in this category must also have taken at least two years of science and social studies. 

"Students in this category must also have taken at least two years of mathematics, science, and social studies. 

5 Precalculus and calculus are also included in this category. 

NOTE: Percentages may not sum to 100 due to rounding. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 17— Distribution of public high school graduates across levels of vocational course taking, by curriculum 
characteristics: 1990 NAEP science assessment sample 



Curriculum 




Vocational credits 






characteristics 


Fewer than 4.0 


4.0 to 7.9 


8.0 or more 


Unweighted Ns 


Total 


55.4 


33.7 


10.9 


3,123 


(s.e.) 


(1.67) 


(1.40) 


(l.lt) 




Curricular specialization 1 










College preparatory 


82.6 


16.6 


0.9 


1,080 


(s.e.) 


(2.25) 


(2.07) 


(0.37) 




Vocational 


2.5 


56.5 


40.9 


697 


(s.e.) 


(0.68) 


(3.53) 


(3.70) 




All others 


63.1 


34.2 


2.8 


1,346 


(s.e.) 


(2.50) 


(2.45) 


(0.45) 




Compliance with A Nation 










at Risk recommendations 2 










All requirements 


76.5 


22.6 


0.9 


448 


(s.e.) 


(3.50) 


(3.23) 


(0.55) 




English, math, science, 










nn/j crvM q 1 chtH i pc 




71 1 


3.4 


905 


(s.e.) 


(2.73) 


(2.26) 


(0.75) 




English and math 3 


51.4 


38.7 


9.8 


660 


(s.e.) 


(3.27) 


(2.47) 


(1.61) 




English 4 


34.6 


51.3 


14.1 


429 


(s.e.) 


(2.71) 


(3.11) 


(2.29) 




All others 


38.5 


38.7 


22.8 


681 


(s.e.) 


(4.78) 


(3.63) 


(4.12) 




Academic credits 










0.00-11.99 


4.6 


35.1 


oU.4 


1 A 1 
10 1 


(s.e.) 


(1-63) 


(6.77) 


(7.14) 




12.00-15.99 


19.4 


59.7 


21.0 


946 


(s.e.) 


(2.37) 


(2.85) 


(2.61) 




16.00-19.99 


70.0 


28.9 


1.5 


1,269 


(s.e.) 


(2.50) 


(2.32) 


(0.51) 




20.00 or more 


93.3 


6.4 


0.3 


747 


(s.e.) 


(1.61) 


(1.35) 


(0.55) 





Students eligible for both college preparatory and vocational specializations are included in the college preparatory group. 
;See text for a complete description of category definitions. 

'Students in this category must also have taken at least two years of science and social studies. 

'Students in this category must also have taken at least two years of mathematics, science, and social studies. 



NOTE: Percentages may not sum to 100 due to rounding. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 18— Distribution of public high school students across levels of vocational course taking, by curriculum 



characteristics: 1990 NA.EP reading assessment sample 



Curriculum 




• 

Vocational credits 






characteristics 


Fewer than 4.0 


4.0 to 7.9 


8.0 or more 


Unweighted Ns 


Total 


54.5 


36.0 


9.6 


3,106 


(s.e.) 


(1.96) 


(1.53) 


(0.84) 




Curricular specialization 1 










College preparatory 


81.4 


18.4 


0.2 


1,086 


(s.e.) 


(2.17) 


(2.16) 


(0.11) 




Vocational 


2.8 


62.5 


34.7 


715 


(s.e.) 


(0.58) 


(2.10) 


(2.20) 


1,305 


All others 


63.2 


34.2 


2.6 


(s.e.) 


(2.36) 


(2.19) 


(0.50) 




Compliance with A Nation 










at Risk recommendations 2 










All requirements 


73.9 


25.8 


0.4 


466 


(s.e.) 


(3.00) 


(2.96) 


(0.26) 




English, math, science, 










and social studies 


74.7 


22.9 


2.4 


884 


(s.e.) 


(2.72) 


(2.46) 


(0.82) 




English and maur 


47.3 


44.2 


8.5 


624 


(s.e.) 


(3.28) 


(2.86) 


(1.36) 




English 4 


36.1 


46.0 


18.0 


473 


(s.e.) 


(2.78) 


(2.31) 


(1.56) 




All others 


39.3 


43.0 


17.8 


659 


(s.e.) 


(4.95) 


(3.33) 


(2.62) 




Academic credits 










u.uu- 1 1 .yy 


A A. 


^7 ft 


J 1 .0 




(s.e.) 


(2.65) 


(5.12) 


(6.13) 




12.00-15.99 


17.7 


63.0 


19.3 


892 


(s.e.) 


(2.74) 


(2.45) 


(1.81) 




16.00-19.99 


66.3 


32.9 


0.7 


1,334 


(s.e.) 


(2.78) 


(2.69) 


(0.20) 




20.00 or more 


93.7 


5.6 


0.7 


734 


(s.e.) 


(1.43) 


(1.25) 


(0.73) 





Students eligible for both college preparatory and vocational specializations are included in the college preparatory group. 
! Sce text for a complete description of category definitions. 

'Students in this category must also have taken at least two years of science and social studies. 

'Students in this category must also have taken at least two years of mathematics, science, and social studies. 



NOTE: Percentages may not sum to 100 due to rounding. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Table 19— Standard errors and unweighted Ns corresponding to table A 


NAEP assessment 
and type of credits 




NAEP assessment score quartile 




Bottom 25% 


2nd 25% 


3rd 25% 


Top 25% 


Mathematics assessment 1 










Total credits 


0.30 


0.19 


0. 19 


0.16 


Vocational credits 


0.17 


0.16 


0.15 


0.09 


Academic credits 


0.25 


0.19 


0.19 


0.16 


Personal use credits 


0.10 


0.09 


0.10 


0.10 


unweighted Ns 


776 


727 


780 


7^8 


Science assessment 2 










Total credits 


0.21 


0.19 


0.14 


0.13 


Vocational credits 


0.17 


0.13 


0.12 


0.10 


Academic credits 


0.20 


0.18 


0.16 


0.15 


Personal use credits 


0.09 


0 1 1 


0.08 


0.10 


unweighted Ns 


822 


751 


774 


776 


Reading assessment 3 






0.16 


0.17 


Total credits 


0.22 


0.19 


Vocational credits 


0.19 


0.16 


0.13 


0.11 


Academic credits 


0.21 


0.18 


0.16 


0.19 


Personal use credits 


0.11 


0.11 


0.10 


0.10 


unweighted Ns 


787 


779 


769 


771 



1 Quartile assessment score ranges are as follows: below 272, 272-296, 297-319, and 320 or higher. 
2 Quartile assessment score ranges are as follows: below 268, 268-293, 294-322, and 323 or higher. 
3 Quartile assessment score ranges are as follows: below 268, 268-291, 292-312, and 313 or higher. 



SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School 
Transcript Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 
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Methodology and Statistical Procedures 
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All analyses presented in this report are based on the sample of students in the 1990 HSTS 
with matched NAEP assessment scores, subject to the following additional criteria: 

• Only public high school graduates are included in the analysis sample; and 

• Complete transcript information, defined as a transcript showing between 16 and 32 credits 
that includes English credits, had to be available. 

The restriction to public high schools is because private schools typically offer few if any vocational 
courses. The restriction to graduates is to standardize students' exposure to courses and to eliminate 
incomplete transcripts from the analysis sample. 

The courses in the HSTS data set were categorized according to the Secondary School 
Taxonomy (SST), which was developed for the National Assessment of Vocational Education 
(Gifford, Tuma, and Hoachlander 1989). The SST organizes transcript data into three different 
curricula: academic, vocational, and personal use/other (figure B.l). The academic curriculum 
was divided into six subject areas: mathematics, science, English, social studies, fine arts, and 
foreign languages. Courses v ithin each subject area were then organized within topical 
concentrations, and where possible within the topical concentrations by level or degreeof difficulty 
(basic, regular, advanced placement/honors, or specialized topics). 

The joint asressment-transcript samples are unique to each assessment. Hence, students for 
whom we have both transcript and math assessment data constitute one sample, students for whom 
we have both transcript and science assessment data constitute a second sample, and students for 
whom we have both transcript and reading assessment data constitute a third sample. As a result, 
each of the joint samples is relatively small compared to the overall transcript sample. About 
75 percent of the HSTS sample have any matched assessment data. Because there is no way to 
determine which assessment would have been taken by students who were included in the transcript 
sample but not in the NAEP sample, the question of bias due to non-response cannot be addressed 
directly. However, the overall pattern of vocational course taking for the joint assessment-transcript 
samples examined in this report does not differ significantly from that for the entire transcript 
sample (table B.l). This indirect measure suggests that the assessment samples are not biased 
in a way that would threaten the generalizability of the findings documented in this report. 

All analyses reported here are based on weighted data to produce nationally representative 
estimates of course taking and achievement. Separate weights are required for each sample, and 
were designed to compensate for the differential probability of selection into the sample and for 
sample non-response. The weights wsre developed by WESTAT, Inc. and are included in the 
"Linked Weights File" of the 1990 High School Transcript Study. The reported achievement scores 
are means of the five NAEP plausible values. For further information about the interpretation 
and use of plausible value scores, see the NAEP technical report (Johnson and Allen 1992). 

The comparisons in the text have all been tested for statistical significance to ensure that 
the differences are larger than those that might be expected due to sampling variation, and the 
standard errors have been adjusted to account for NAEP's complex sample design. Two types 
of comparisons have been made in the text, differences in estimates and trends. 
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Differences in two estimates. Student's t statistic can be used to test the likelihood that the 
difference between two estimates (e.g. , estimates of the average number of credits or the average 
score) is larger than would be expected due to sampling variation alone. Student's t is given by 



/ 2 2 

\jse x +se 2 



where E, and Ej are the estimates to be compared and sej and se2 are their corresponding standard 
errors. 



Table B.l— Percentage distribution of public high school graduates in the 1990 High School Transcript Study 
sample and the joint NAEP assessment-transcript samples, by number of vocational credits completed 



Vocational credits 

Sample Fewer than 4.0 4.0 to 7.9 8.0 or more 



High School Transcript Study sample 

Total 52.0 36.3 11.7 

s.e. 1.21 1.00 0.71 

Unweighted Ns 16,741 16,741 16,741 



JoiLt NAEP assessment-transcript samples 



Mathematics 


55.0 


34.5 


10.5 


s.e. 


1.77 


1.51 


1.07 


Unweighted Ns 


3,061 


3,061 


3,061 


Science 


55.4 


33.7 


10.9 


s.e. 


1.67 


1.40 


1.16 


Unweighted Ns 


3,123 


3,123 


3,123 


Reading 


54.5 


36.0 


9.6 


s.e. 


1.96 


1.53 


0.84 


Unweighted Ns 


3,106 


3,106 


3,106 



NOTE: Distribution may not sum to 100 due to rounding. 



SOURCE: National Center for Education Statistics, National Assessment of Educational Progress, 1990 High School Transcript 
Study, and 1990 National Assessment of Educational Progress 12th Grade Assessment File. 



As the number of comparisons on the same set of data increases, the likelihood that the 
t value for at least one of the comparisons will exceed the critical value simply due to sampling 
error increases. For a single comparison, there is a 5 percent chance that the t value will exceed 
1 .96 due to sampling error. For five tests, the risk of getting at least one t value that high increases 
to 23 percent, and for 20 comparisons it increases to 64 percent. 

One way to compensate for this problem when making multiple comparisons is the Bonferroni 
adjustment, which involves adjusting the alpha level (i.e., the chance of finding a false positive 
due to sampling error) to take into account the number of comparisons being made. For example, 
rather than simply establishing an alpha level of 0.05 as it would be for a single comparison, 
the alpha level is set to ensure that the likelihood of finding a significant t value by chance alone 
is 0.05 for a set of comparisons. The Bonferroni adjustment is calculated by taking the desired 
alpha level and dividing by the number of possible comparisons, based on the variable(s) being 
compared. The t value corresponding to the revised, lower alpha level must be exceeded in order 
for any of the comparisons to be considered significant. 

The Bonferroni adjustment was applied for all significance tests in this report that involved 
multiple comparisons. Where categories of two variables were involved, the number of comparisons 
used to make the Bonferroni adjustment was based on the relationship(s) being tested. 

Trends. Regression analysis was used to test for linear trends in the relationship between 
ordered variables. Regression analysis assesses the degree to which one variable (the dependent 
variable) is related to a set of other variables (the independent variables) . The estimation procedure 
most commonly used in regression analysis is ordinal least squares (OLS). 

Dependent variables for trend analysis were either the average number of credits, or the 
average NAEP score. Independent variables were linear contrast variables corresponding to the 
quartile rank on the NAEP assessment or the level of vocational course taking. Because the 
dependent variables for this analysis were themselves estimates with standard errors of differing 
magnitude, a weighted least squares procedure was used to obtain unbiased regression parameters. 
The weighting procedure involved creating a set of transformed dependent and independent variables 
by dividing all observations by the standard error of the dependent variable. In order to obtain 
an unbiased estimate for the constant term of the regression, the reciprocal of the weight was 
also entered as an independent variable. OLS regression through the origin was then applied to 
the transformed variables. 

All transformations and regressions were performed using the data manipulation and regression 
capability of Microsoft Excel. Significance testing for the analysis of linear trends consisted of 
a two-tailed t test of the coefficient for the linear contrast variable. All statements about trends 
in this report are statistically significant at the 0.05 level. 

Estimates were reported in tables if 30 or more observations were available in the sample 
to generate the estimate. Because of the complex sampling design used in NAEP and the use of 
plausible values, differences between two estimates of average NAEP scores were tested if each 
estimate was based on 62 or more observations. Since a trend test has greater statistical power 
than pairwise t tests, trend tests were conducted when each estimate was based on 30 or more 
observations. 

Measures ofcurricular exposure. The simplest measures of students' curricular exposure 
are based on a count of the number of academic, vocational, or personal use credits earned. Another 
course- taking measure indicates overall curricular specialization and identifies three groups : college 
preparatory students; vocational concentrators, defined as those with at least 3.0 credits of specific 
labor market preparation in a single field; and all others. The college preparatory curriculum is 
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defined according to the breadth and depth of academic course taking: at least 4.0 credits of English; 
at least 3.0 credits of mathematics, with at least 1 .0 credit at or above algebra I; at least 3.0 credits 
in science, with at least 1.0 credit in chemistry, physics, or advanced biology; and at least 2.0 
credits in a single foreign language. The small number of students meeting the criteria for both 
the vocational and college preparatory categories was too small to report separately, and these 
students were included in the college preparatory group. It is likely that the average achievement 
scores for studer's classified as vocational would be higher if students who met both criteria 
were placed in this category. 

Another measure of curriculum is compliance with the graduation requirements recommended 
in A Nation at Risk, which calls for 4 years of English, 3 years each of mathematics, science, 
and social studies, 2 years of a single foreign language (recommended for college-bound students), 
and half a year of computer science (National Commission on Excellence in Education 1983). 
Students' course taking is characterized here along a continuum of compliance with these 
recommendations as follows: 

• Met all recommendations; 

• Met the English, mathematics, science, and social studies recommendations; did not meet 
one or both of the foreign language and computer science recommendations; 

• Met the English and mathematics recommendations, plus at least 2 years of science and 
social studies (but not three years of both); 

• Met the English recommendation, plus at least 2 years of mathematics (but less than three) 
and at least 2 years of science and social studies; and 

• All others. 

While this is only one of many possible ways to capture degrees of compliance with the 
recommended curriculum, the measure has two desirable characteristics: it prioritizes certain subject 
areas (assigning greatest weight to English, followed by mathematics and then science and social 
studies, with the least weight assigned to foreign language and computer science), and it results 
in a useful empirical distribution. One must also be aware of the strengths and limitations of this 
approach. The last category should not necessarily be interpreted as the least rigorous, since it 
includes students who were excluded from the other categories due to any one of the following 
shortcomings: less than 4 years of English; less than 2 years of mathematics; less than 2 years 
of science; or less than 2 years of social studies. These students may have taken an otherwise 
rigorous curriculum. More generally, while this measure compares the list of courses completed 
with the standard in A Nation at Risk, it does not capture other important aspects of a student's 
educational preparation (for example, the specific content of courses, the quality of instruction, 
and student effort and achievement in the courses). 

Two other measures assess the amount and level of exposure to the mathematics curriculum, 
and only appear in tables related to mathematics achievement. The first is based on a simple count 
of the number of mathematics courses completed, and the second on the highest level of 
mathematics course completed. 
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